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ABSTRACT 

Investigation theory treats discrete combinatorial opti- 
mization problems in which there are several objects passing 
through a region containing one or more investigators who 
are to investigate, according to some criteria, objects 
prior to their escape across a portion of the boundary of 
the region. In general, investigation times are sequence- 
dependent functions of the time investigation is initiated. 
This research treats problems with one investigator under the 
criteria of minimization of the number of objects to escape 
uninvestigated. Those problems for which optimal solutions 
can be efficiently obtained are identified and algorithms 
developed. For the general problem, heuristic solution 
methods are suggested and evaluated through comparison of 
results obtained with optimal solutions. An analysis is 
presented for problems with uncertain investigation times and 
also for problems in which objects are not immediately avail- 
able for investigation. Generalizations to m.ore than one 
investigator and an alternate objective are discussed. The 
relationship between investigation and jobshop scheduling 
problems is illustrated throughout. 
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I. 



INTRODUCTION TO INVESTIGATION THEORY 



A. INTRODUCTION 

This research deals with problems in an area called 
Investigation Theory [Refs. 8 , 36]. In these problems, an 
investigator and several objects, called targets, are located 
in a region and some of the targets are proceeding toward a 
border of the region. The investigator is to investigate 
targets prior to their crossing the border in order to 
optimize with respect to some prescribed objective. 

Apart from the objective, such problems resemble the 
traveling salesman problem and certain classes of job-shop 
scheduling problems. However, the feature of investigation 
problems which sets them apart from other classes of problems 
appearing in the literature is the criteria of optimization. 
Although many specific criteria can be developed, all are 
concerned with completing investigations prior to target 
escape across the border. This research represents an 
analysis of investigation problems under the objective of 
minimization of the number of targets to escape across the 
border uninvestigated. 

The author was introduced to Investigation Theory while 
attached to the Operations Evaluation Group at the Center 
for Naval Analysis. As a result of analysis of several on- 
going military operations, a deficiency in existing theory 
was recognized. The particular problem which illuminated 
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this deficiency was related to the Markettime operation 
which was being conducted along the coast of South Vietnam. 

In the early stages of the Vietnam conflict a principal 
means of logistic support for the guerilla forces operating 
in South Vietnam was via the sea. Ships of various sxzes 
would rendezvous at predetermined locations on the beaches 
and offload needed supplies and food. In an effort to sever 
or at least curtail this source of supply. South Vietnamese 
and allied forces divided the coastal waters into regions and 
assigned patrol craft to each region. The search of coastal 
waters was conducted primarily by aircraft, and detected 
surface craft were intercepted and inspected by surface 
patrol craft . 

Procedures for carrying out the air search for possible 
Infiltrators were quickly obtained through application of 
methods previously developed and embodied in the theory of 
search and detection. The responsibility for investigating 
those surface craft detected to determine whether they were 
carriers of enemy supplies rested with the surface patrol 
craft assigned to the regions. In many instances the number 
of contacts to be investigated exceeded the capabilities of 
the surface patrol craft. Since there did not exist a 
unified body of knowledge interfacing with and complementing 
the theory of search and detection for use in developing 
procedures for the patrol craft commanders to follow in such 
situations, they simply used their best judgement in 
attempting to carry out their assigned missions. 
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Analysts considering this problem found themselves 
unable to specify optimal policies for conducting such 
investigations, and in fact, were not even able to suggest 
one usable rule of thumb which vras knovm to be good. 

Recognizing this deficiency. Dr. J. A. Neuendorf fer 
submitted a request for analysis [Ref. 8 ] in which he used 
the term "investigation problem" to describe such situations 
and dubbed that body of knowledge to be developed to treat 
them as "Investigation Theory." Except for a literature 
search [Ref. 36], apparently no research was directed toward 
this area until 1970 when the research being reported here 
was begun. 

This research does not treat any problem, related to the 
development of sets of strategies for use by opposing forces, 
however, the results obtained would perhaps be of use to 
game theorists in any such endeavor. 

B. CURRENT RESEARCH RELATED TO INVESTIGATION THEORY 

The investigation problem v/as Identified and the term 
"investigation theory" defined in Ref. 8 . Literature 
searches for related research are contained in Refs. 35 
and 3 6 . 

In Ref. 8 it is suggested that the development of 
Investigation theory should begin through consideration of 
problem.s in which all targets have speed zero. The similar- 
ity between such problems and the traveling salesman problem 
suggested application of existing solution methods for the 
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latter problem. The first solution method designed specif- 
ically for an investigation problem is presented in Ref. 35 , 
in which the zero target speed problem is solved using a 
modification of the branch and bound algorithm of Little, 
et al. [Ref. 27]. 

Solution methods developed for various types of target 
motion are contained in Refs. 1, 2 , 35> and ill, all of 
which are incorporated into this dissertation. 

The investigation problem treated here is closely related 
to the jobshop scheduling problem in vjhich the objective is 
to minimize the number of late jobs. This problem is de- 
scribed by letting p^ be the combined set-up and processing 
time for job i and d^ the due-date. Let decision variables 
Xj^=l if job i is included in the schedule and 0 otherv;ise, 
for i = l,2,...,n. The problem is to 

n 

maximize E x. 

• T 1 

1=1 

i 

subject to E p.x, £ d. i = 1,2,. 
j=i ^ ^ 

For the case where the combined set-up and processing 
times are deterministic and sequence independent, Jackson [ 38 ] 
proves the existence of an optimal schedule in v;hich all 
jobs are ordered according to non-decreasing due-dates. In 
Ref. 32 a very simple algorithm for obtaining optimal solutions 
for this problem is presented. Problems in which set-up or 
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processing times are sequence dependent are usually formulated 
as traveling salesman problems [Ref. 12]. 

Existing solution techniques for the traveling salesman 
problem are summarized in Ref. 4 , in v;hich, after an analysis 
of computational results, it is recommended that dynamic 
programming [Ref. 21] be used for problems with 13 cities 
or less, and that branch and bound [Ref. 38 ] be used for 
the rest. A rather complete survey of branch and bound 
methods is contained in Ref. 26. Several applications of 
the branch and bound technique to scheduling problems are 
contained in Refs. 5 j 22, 27> and 31- 

Other references are cited throughout the dissertation 
as their relation to the investigation problem becomes 
apparent . 

C. RESEARCH OBJECTIVES 

The broad objective of this research is an analysis of 
investigation problems with one investigator in which the 
objective is minimization of the number of targets to escape 
uninvestigated, with generalization, where possible, to 
related problems. The principal goal has been the develop- 
ment of practical techniques for obtaining optimal or near 
optimal solutions to the class of problems described, while 
at the same time developing a theoretical framework for 
understanding more general problems. 

Specific objectives include the following: 

1. Subdivide the class of problems, identifying those 
for which optimal solutions can be obtained relatively easily 
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through exploitation of special structure, and develop 
efficient algorithms for obtaining these optimal solutions. 

2. For those problems whose structure does not lend 
itself to solution methods efficient enough for practical 
use, evaluate heuristic solution methods. 

3. Determine the most general class of problems for 
which solutions can be expected to be obtained. 

M. Provide a theoretical basis for extending this 
class through analysis of problem structure. 

5. Develop an algorithm for obtaining optimal solutions 
to the most general problem treated in support of objectives 
2 through 4 . 

It is hoped that the results obtained in this research 
will provide others v/ith a foundation upon v/hich to build 
a unified theory of investigation. 

The results obtained are reported in the sections which 
follow. In Section II a mathematical description of the 
Investigation problem is presented, followed by a discussion 
of its analytical characteristics and the relative merit 
of possible approaches. Section III identifies a class of 
problems with special structure for which optimal solution 
methods have been developed. Section IV deals with those 
problems for which methods yielding optimal solutions are 
computationally impractical. Methods of development and 
evaluation of heuristic solution techniques are suggested 
and illustrated by example. The algorithm developed in 
fulfillment of objective 5 is presented with sufficient 
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description to be of use to others v;ho may wish to evaluate 
new or alternate non-optlmal solution methods. Section V 
discusses the implications of uncertain investigation times 
and identifies a special class of problems for which an 
extremely efficient optimal solution method has been devel- 
oped. In Section VI, problems in which all targets are not 
immediately available for investigation are considered. 
Section VII discusses generalizations of the problem and 
their applicability, and suggests possible avenues for future 
research. 
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II. PROBLEM DESCRIPTION 



A. GENERAL DESCRIPTION 

An Investigation problem is one in which there are 
several targets passing through a region containing a 
distinguished object, called the investigator, who is to 
investigate, according to some criteria, the targets prior 
to their escape across a portion of the boundary of the 
region, called the border. An optimal solution to such a 
problem is the specification of which targets will be 
investigated, and in what sequence, in order to optimize 
with respect to this criteria. 

It is assumed that the following Information is either 
implied or specified in an investigation problem formulation. 

1. The meaning of Investigation. 

2. The region in which targets are located and the 
subregion to which the motion of the investigator 
is restricted. 

3. The motion characteristics of the investigator 
and targets. 

The criteria or objective of the investigator. 

For illustration, consider the example situation depicted 
in Figure 2.1. The region where the targets and investigator 
are located is planar and the investigator is restricted 
to remain in the square subregion. Target locations are 
represented by numbered dots and their motion by vectors 
emanating from their locations. The Investigator is in 
position 1. Suppose an investigation is considered complete 
when the location of a target is reached by the investigator 







and let the objective be minimization of the munber of 
targets to cross the border uninvestigated. An optimal 
solution is a path for the investigator to follow which 
contains the greatest number of targets. 

B. MATHEMATICAL DESCRIPTION 

The investigator is always designated as target number 
one. A solution to an investigation problem is represented 
by a permutation of target num.bers indicating an order in 
which targets included are investigated. Square brackets 
are used to denote position in sequence in a permutation, 
thus the symbol [i] represents the target number which is in 
the i^^ position in sequence in some permutaL.ion . 

The following notation is used. Let 
TT = .. be a permutation of m elements from 

the set {l,2,...,n>, m < n, representing an order 
in which targets investigated. 



15 



= the earliest time at which target i is available 
for investigation for i=2,...,n. 



e^ = the escape time of target 1 if not Investigated 

for 1=2 , . . . ,n. 



IT 



= t 



i 



[ 1 ] 



the time required to investigate the 1 targets 
iT^ , it 2 , . . . , IT , in that order. 



ij(tp 



the time required to Investigate target j given 
that investigation of target 1 is complete at 
time t^. 



Let ^[ 0 ] “ Then 



_ j=l-l 

^[1] " ^Iq ^[j+l]^^[j]^ • 



If ^ ^[1] ’ then Includes a 

delay in the commencement of investigation of target 1 due 
to its nonavailability at time 

Until generalizations are presented in Section VII, th 
objective considered exclusively is that of minimizing the 
number of targets to escape uninvestigated, which is equiva- 
lent to maximizing the number of elements in the solution 
permutation it. The latter form is used and described by 
defining | | as the number of elements in tt, and the problem 

thus is to determine tt which will 
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maximize 



7T 



s . t . 



t 



7T, 



1 



< 




7T . e TT 
1 



(2-1) 



Constraints (2-1) require that the investigation of 
each target contained in tt be completed prior to its 
escape . 

In an n target problem there are Z (^’*'^)m! possible 

1 m 

solutions, the investigator alv;ays being designated as 

target number one. The set of feasible solutions consists 

of all IT for which constraints (2-1) are satisfied. Note 

n-1 

that an n target problem contains Z m(^~‘^)m! constraints. 

m=l 

C. DISCUSSION 

The fundamental nature of Investigation problems is 
that of optimization over a discrete set. Identifying them 
to be problems in. discrete mathematics. Unfortunately, 
there does not exist a unified theory of discrete mathematical 
optimization [Ref. 37]. Investigation problems are thus 
defined and treated as a special case. 

The meaning of "investigation" is left undefined in 
general and is made a requirement of the particular problem 
formulation, but is intended to be an action carried out by 
the Investigator, with respect to a target, which is 
desirable for some reason. 
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V/hen applicable, investigation times include the time 
of any travel required in the conduct of the investigation. 

It can thus be seen that these times may be sequence depen- 
dent functions of the time investigation is initiated. In 
a job shop context, this corresponds to combined set-up 
and processing times which are both sequence dependent and 
functions of start times. The existence of just sequence 
dependence very seriously complicates the problem as evi- 
denced by the great interest in and difficulty associated 
with obtaining solutions for the traveling salesman problem. 

A great deal of theory has been and continues to be developed 
in support of the search for an efficient, direct solution 
technique for the traveling salesman problem, and one might 
suspect that these ideas would be useful in solving investi- 
gation problems. Although existing traveling salesman 
theorems [Ref. 4 ] reveal characteristics of optimal solutions 
for that problem, they do not even apply to solutions for 
investigation problems due to the movement of targets from 
their Initial locations and the criteria of optimization. 

This is illustrated through consideration of several theorems 
presented by Barachet and Flood [Refs. 3 and 17 ] and 
discussed by Bellmore and Nemhauser [Ref. 4 ]. 

Theorem 2 of Ref. i| states that under the Euclidean 
distance measure, there exists an optimal traveling salesman 
tour which will not cross itself. The Euclidean measure is 
clearly applicable in Investigation problems, yet this 
theorem is not, as illustrated by the following example 
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shown in Figure 2.2. Let the problem situation be that 
described for the example of Figure 2.1 vjith all targets 
moving directly toward the border at the same speed. Let 
the investigator's maximum speed be the same as the target's. 
The dotted path is clearly optimal since it is the only 
feasible path containing all targets, yet the path crosses 
Itself. 




Figure 2.2 

Theorem 3 of Ref. ^ states that if G is the convex 
hull of targets in two-dimensional Euclidean space, then 
there exists an optimal tour in which the relative order of 
the points on the boundary of the convex hull is preserved. 
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Using the same example situation with initial positions as 
shown in Figure 2 . 3 , the dotted path again is the only 
feasible path containing all targets, yet the relative order 
of points on the convex hull is not preserved. 




Figure 2 . 3 

The complete constraint set for a problem is represented 

n-1 

implicitly by constraints (2-1) because the E m( )m! 

m=l 

constraints are too numerous to be explicitly stated. For 
example, in a problem with the investigator and only ten 
targets, this number is 88,776,910. 

The Integer nature of the variables suggests that integer 
programming is an appropriate approach to optimization, and. 
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with sufficient Ingenuity, most problems treated to date 
have such a formulation. Unfortunately, almost all of these 
formulations are of negligible computational Interest due 
to the enormous number of constraints. An exception will 
be presented in Section V. 

One of the objectives of this research is to obtain 
optimal solutions to investigation problems for use in 
analysis of problem structure and also in the development 
of practical heuristic solution methods. It v/as thus 
necessary to develop an algorithm for obtaining optimal 
solutions . 

The only problem other than the traveling salesman 
problem bearing a resemblance to the investigation problem 
which is treated to any extent in the literature is the job- 
shop scheduling problem with due-dates and sequence dependent 
set-up times. Even then the resemblance is restricted to 
solution and constraint sets in that the criteria of 
optimization, "minimize the number of late jobs," remains 
essentially untreated. The problem considered by Moore and 
others, [Refs. 1 , 13, 30, and 32 ] uses this criteria, but 
processing times are sequence independent. It is argued 
that problems v;ith this structure are best treated through 
application of combinatorial programming techniques [Ref. 16 ] 
It was thus decided to develop a branch and bound algorithm 
for obtaining the needed optimal solutions to the general 
problem presented in Section II, B. 
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D. SUMMARY OF PROBLEM TREATMENT 



In Sections III through VI the problem of Section II, B 
is considered as follov/s. 

Section III treats investigation problems in v;hich a 
known ordering is imposed on the set of all feasible solu- 
tions. This class of problems is shown to be efficiently 
solved through a dynamic programming formulation. It is 
shown that even more efficient methods are possible through 
the development of a simple matrix algorithm for a certain 
subproblem. 

In Section IV, the general problem of Section II, B 
is analyzed. Optimal solutions to randomly generated sample 
problems are used to illustrate how heuristic solution 
methods can be developed and evaluated. The algorithm 
used to obtain the optimal solutions is presented and 
Illustrated by application to a particular problem formu- 
lation. The most general problem v;hich can be expected t< 
be solved using the algorithm is identified in terms of 
target and investigator motion characteristics. 

In Section V the notion of uncertainty is Introduced 
through consideration of the problem in v/hich sequence 
independent investigation times are known only in proba- 
bility distributions. The sequence independence feature 
allows an integer programming formulation in which the 
number of constraints is not prohibitive. It is illustrated 
that when such formulations are possible, the chance constraint 
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technique of Charnes and Cooper may be applicable. A very 
efficient algorithm v;hich is proved to produce optimal 
solutions for this formulation is presented. 

In Section VI problems in v/hlch targets are not avail- 
able at problem time zero are analyzed. Theorems are 
developed and used in the construction of direct solution 
methods for several types of problems, and in the development 
of significant accelerations for combinatorial approaches. 

Section VII contains a discussion of several generali- 
zations to'the problem, not within the scope of this 
research, which appear to be promising prospects for future 
research. 
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III. SPECIFIED ORDERING 



A . PRELIMINARY REMARKS 

A group of problems v;hlch can be efficiently solved 

Includes those for which all targets are available at time 

zero and a knov;n ordering is Imposed on the set of all 

solutions. This corresponds to having a solution space 

containing only the Z subpermutations of a 

i=l ^ 

single permutation tt , i.e., all subsets of elements {fT 2 > •-. 

ordered as in ir. The number of constraints on such a problem 

i=n-l , 

is thus reduced to Z ) (n-i-1 ) . 

1=1 ^ 

The known ordering, corresponding to the order in which 
indices appear in tt, can arise in a variety of ways. For 
example, in the case where investigator's motion is restricted 
to the border, either Investigations are performed in the 
order in which targets reach the border, (escape time order), 
or not at all. Jobshop scheduling problems with scheduling 
disciplines imposed which are formulated as investigation 
problems also have this characteristic in that all optimal 
schedules must conform to the order specified by the disci- 
pline. As an example, the first-come, first-served discipline 
corresponds to investigating targets in the order in which 
they arrive in the region. (Note also that the escape time 
order corresponds to the due-date order.) 

If such an ordering exists, combinatorial complications 
are greatly reduced. This is seen by recognizing that the 
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decision problem reduces to excluding the minimum number of 
indices from tt in order to produce feasibility, and that 
the search for the optimum is guided by the known ordering. 

Many potential applications of the results obtained for 
this problem are known, including: the defense of a coast- 
line from Infiltrators as discussed in Section I, point and 
area defense problems, and submarine barrier problems. 

One methodology which can be used to solve such problems 
(see Ref. 2 ) is dynamic programming, as illustrated in the 
following section. Even more efficient methods are possible 
for special cases, as shov/n in Section III,C. 

B. DYNAMIC PROGRAMMING FORMULATION AND SOLUTION OF 

PROBLEMS HAVING A SPECIFIED ORDERING 

To clarify presentation and aid in understanding, the 
dynamic programming formulation is described in terms of a 
simplified version of the problem in which all targets ha\ 
the same motion directly tov;ard the border at the same sp( 3d, 
and, the investigator is required to remain on the border, 
(thus specifying an escape time order). Investigations are 
considered complete when the position of the target is 
reached. This version is easily solved using a graphical 
technique guided by the dynamic programming principle of 
optimality. Afterwards, generalizations are presented which 
consider problems with more than one investigator, and 
specification of arbitrary orderings on solutions is allov/ed. 
Further generalizations include arbitrary courses and speeds 
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for the targets, alternate meanings of Investigation, and 
different objectives. 

1. Dynamic Programming Formulation of Problems V/ith 
One Investigator on the Border 

In the problem being considered there are n targets 
located in a rectangular region with Initial locations 
given as (x^, y^) for i = l,...,n. See Figure 3.1. Inter- 
val [0,R] of the x-axls is the border of the region and all 
targets are proceeding directly toward the border at speed 
S 2 ‘ Initially the investigator is required to remain on 
the border. His objective is to Investigate as many targets 
as possible as they reach the border. The investigator has 
maximum speed s^ and can reverse direction instantaneously. 

This problem is formulated as an n stage dynamic 
programming problem [Ref. 33] > as follov/s. Order and index 
all targets according to .decreasing distance from the border. 
Assign all targets with equal distances the sam.e index. Let 
stage j correspond to the time target j+1 arrives at the 
border. Stage n is thus the beginning of the problem. The 
state variable X. represents the position of the investigator 

J 

on the border at stage j, and f.(X. ) is the m.aximum number of 

J J 

targets which can be Investigated prior to escape from am^ong 

targets l,...,j, given state X.. The decision d. at stage j 

J J 

is to move along the border from X. to X._-, . The return at 

J J 

each stage, r.(X.,d.), equals one if target j is investigated 

t) J 0 

and zero otherv;ise. 

Let e^ be the time target j reaches the border and 

define F. = e. - e.,, . The recursive equations are 
J J J * 
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(targets ) 




Figure 3.1. An Investigation problem 
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fl(Xi) = max r^(X ,d ) 

and 



f. (X ) = max{r (X ,d ) + f (X ^)} 
J J ^ J J J J J 

j 



where 



X. = X. + d. 
J-1 3 3 



and 



-St t . < d . 

1 J - J 



< St t . 

- 1 J 



and 



-X. < d. < R - X. . 

J - J - J 

The first constraint on d. limits the maximum distance 

J 

which the investigator can move during time F. and the 
second requires that the investigator remain in the interval 
[0,R]. 

Note that the return function is 



Consider the situation where k targets arrive at 
the border simultaneously. At most one target can be Inves- 
tigated, hence r. = 1 If X. + d. = x. for any such target. 

J 1 0 J 

Note that If this occurs that the problem is reduced 

to an n-k+1 stage problem since all k targets are 

assigned the same index. 

2 . Graphical Solution for the Problem With One 
Investigator on the Border 

The recursive equations can be solved in the usual 

way to obtain an optimal solution, however, for this 

problem, a simple graphical method is also possible. 

In the graphical method, decisions are simplified 

by noting that at stage j, given any state X., the deter- 

mlnation of whether target j can be investigated can be 

resolved by drawing a cone with vertex at the position 

of target j and noting whether X. is contained inside the 

cone. See Figure 3-2. The shape of the cone is determined 

by F. and s . Even if target j can be investigated given 
J 

state X., it may not be optimal to do so since moving to 

X. may put the investigator in a bad position with respect 
J 

to targets l,2,...,j-l. This condition is reflected in 

f. , (X. ,) which is recorded for each possible point X. , 
j -1 j -1 1-1 

on the transposed border passing through target J . 

The graphical solution is carried out by recursively 

drawing the border through each target’s initial position 

and recording for each stage 2,...,n the quantity f.(X.) 

J J 

which specifies the maximum number of investigations 
possible . 
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Figure 3-2 Cone for a single target. 

The method is illustrated with an example. For 

the problem pictured in Figure 3.1, let s^ = 2 and S 2 = 1. 

The solution is shovm in Figure 3.3* The num.bers on the 

horizontal lines give the values of f.(X.). The optimal 
' J J 

solution shows that the investigator can at best investigate 
six targets. 

3 . Multiple Investigators on the Border 

The dynamic programming solution method presented 
for the problem with a single Investigator is computationally 
simple. The formulation given is also applicable to the 
problem of scheduling m investlgatoi against n targets to 
maximize the number of t’argets investigated. In this 
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Figure 3.3. Graphical solution to example problem. (An 
optimal sequence is indicated by the dotted line.) 
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section, the problem considered is one in which the inves- 
tigators all stay on the border and are permitted to cross 
one another. Their maximum speeds may differ. To handle 
this generalization, it is only necessary to interpret the 
state variable as an m-vector v;hose components give the 
positions of each investigator at the time a target reaches 
the border. This is easily visualized, and easily computed 
for the case m = 2. The state space simply becomes a 
portion of the plane. Regions in the space are recursively 
labeled to Indicate the maximum number of remaining targets 
which can be investigated from that point in the space. 

The method is illustrated with an example. 

H . Example and Solution 

In this section a problem having m = 2 and n = 5 
targets is presented and solved. Table 3*1 gives the target 
data. Investigator one has speed of one unit per unit time 




Table 3«1- Target data 
for sample problem with m = 2. 
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and investigator 2 has a speed of 2. Figures 3*^ through 

3.9 show the original problem and the functions f.(X.), 

j = 1,...,5 where X. .,i=l,2 is the position of investigator 

r J 

i at stage J . 



Time of 
Crossing 



8 - 

7- 

6 ' 
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Figure 3.^. Problem data for example with m - 2 
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Figure 3.5. f^(X^) for example problem 




Figure 3.6. f 2 (X 2 ) for example problem 
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Figure 3.7. f^CX^) for example problem 







Figure 3.8. f^iCX^i) for example problem. 
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Figure 3 - 9 • f^(X^) for example problem 

Note from function f^(X^) that the two investigators 
can at best investigate four targets and this can occur 
only if investigator one has a starting position between 
three and six and investigator two has a starting position 
to the right of four. In the worst case, corresponding to 
the regions labeled with a two, the investigators will be 
able to investigate only two targets. 

5. Arbitrary Orderings 

In order to consider arbitrary orderings on the 
solution set, it is necessary to relax the requirement that 
the investigator (s ) remain on the border. To solve such 
problems using dynamic programming, the state variable X 
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must have m+1 components where m Is the dimension of the 
region. The first m components give the position of the 
investigator and the other gives the time. 

s t 

stage j is again identified by the j+1 target 
reaching the border. The decision is which target to 
investigate next. The solution be dynamic programming would 
require imposing an m-dlmensional grid over the region R 
and performing the standard dynamic programming calcula- 
tions. For problems with more than one investigator, the 
dimension of X Increases by m for each additional investi- 
gator. Consequently, dynamic programming becomes impractical 
very rapidly. 

6 . Further Generalizations 

When regarding the state variable X as a vector, 
other slightly different interpretations of the problem are 
possible. Returning to the single investigator problem, 
it is possible to permit the border to be m dimensional as 
would be the case .when the investigator is guarding a por- 
tion of a plane. See Figure 3.10. In this case, the compon- 
ents of X are simply the position of the investigator on 
the plane. 

Llkev/ise , some com»ponents of X can be interpreted 
to be descriptions of the physical condition of the inves- 
tigator. For example, it is possible to permit the inves- 
tigation of a target to change the maximum speed at which 
the investigator can travel. This could be used for the 
case in which investigation of some target is a dangerous 
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operation and results in damage to the investigator. In 
fact, the occurrence or non-occurrence of damage could be 
permitted to be a random event. 




Figure 3*10 A two dimensional boundary defense p’^oblem. 

For the problem in xvhich the investigator must remain 
on the border the solution procedure can easily be modified 
to include several other generalizations in addition to 
interpreting the state variable as a vector. For example, 
each target can move with a different speed and heading. 

The speed will affect the width of the cone and the heading 
will affect its projection on the boundary. In fact, it 
doesn't matter where the target begins or what path it follows 
to reach the boundary. It can move in any manner at all as 
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long as its point and time of crossing are known. For such 
cases where targets are approaching the border at different 
speeds, it is necessary to order the stages (number the 



targets) so that they arrive in the order n, n-l,...,l. 

Also note that a value or priority V. can be assigned 

J 

to each target to reflect the importance of investigating 

it. This would be done by letting r.(X.,d.) = V. if inter- 

J J J 0 

ception is made and zero otherwise. The problem would 

remain one of maximizing the V.'s summed over those targets 

J 

which were Intercepted. 

In another generalization it is possible to assume 
investigation is complete when the investigator is within a 
distance d of the target when he reaches the border. It is 
also possible to solve the problem for the case in which 
each target remains on the border for a finite time before 
penetrating. The case in which a finite processing time is 
required for each target is also handled easily. Likewise 
it is easy to deal' with cases vjhere the Investigators are 
given different maximum speeds, perhaps zero, in moving left 
or right. 



C. A MATRIX ALGORITHM FOR PROBLEMS V/ITH A SPECIFIED ORDERING 
Under certain conditions it is possible to develop even 
more efficient algorithms for obtaining optimal solutions. 
Such a problem is one in which targets must be investigated 
in a specified order, the investigator is allov;ed off the 
border, and target motion is directly toward the border at 
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the same speed, (see Ref. ^1). In this case, investigation 



times are sequence dependent but independent of start time, 
i.e., I^.(t^) = , for i = l,...,n, j = 2,...,n. 

1 . The Algorithm 

Let TV = (iT^,Tr 2 > ••• specify an ordering to 

which all optimal solutions must conform. If it is feasible, 
i.e., if 



t = e 

TTi TV. 



for i = 2 , 3 , . . . ,n , 



this sequence is optimal. If not, one or more target indices 
must be excluded from tv to produce a subpermutation vvhich 
is feasible. Suppose tv. is the first index in tv such that 
t > e , then from among indices ’ tv, ,... ,tt, , that index is 

TVj TVj " 1 ’ ’ J ’ 

excluded from tv which minimizes the time required to inves- 
tigate the remaining targets. This rule is repeated each 
time an exclusion is required. 

The steps. in the algorithm are as follows. 

1) ■ Index targets according to the order specified 

in TV and form the upper triangle of the n by 

(n-1) matrix (I..) of elements I., for i < j. 

1 j 1 j 

2) Augment the matrix with an additional row 

which contains the escape times for the targets. 

3) Compute the completion time t^, i = 2,...,k 
where 



t-=0, t. =t. ,+I. 

1 ’ 1 1-1 1 - 1,1 






For the first k such that go to step . 

If t^ < e^, i = 2,...,n, then the minimum number 
of targets to escape is zero. 
i{ ) For each column 2,...,k compute the savings 
where 

" ^i+1 ■ ^^i-1 ^i-l,i+l^‘ 

5) From the matrix, delete rov; and column h such 

f 

that 

S, — max- {S., i ~ 2,...,k} . 
h 1 

Go to step 3 and recompute starting with 

target h+1. (Note that after the matrix is 
reduced, the subscripts refer to relative pos 
tions of columns in the matrix rather than ta get 
numbers in the computational formulas for t^ 
and . ) 

The set of columns in the final matrix specifies 
the largest set of targets which can be investigated before 

their escape. 

2 . Example 

The algorithm will be Illustrated with the following 
example. Let the augmented matrix of step 2 be that shown 



in Figure 3 • H • 
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Figure 3.11 The Augmented Matrix 



The elements from row 10 have been moved up under 
the main diagonal for convenience. Step 3 has been carried 
out until t^^ > e^. t^'s are shown in the main diagonal 
spaces. Step 4 has been completed with S^’s shown in the 
parenthesis in the main diagonal spaces. The quantity S^ 
is max {S^, i = 2,3,4}, so row and column 4 are to be 
deleted prior to returning to step 3- 

The reduced matrix is shown in Figure 3-12 and 
again steps 3 and 4 have been completed showing 
max {S^, i = 2,3,5,d} to be S^. Row and column 5 are 
deleted and step 3 is returned to again. The resulting 
reduced matrix is shown in Figure 3 "IS* 
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Figure 3.12 The First Reduced Matrix 
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Steps 3 and 4 show now that Sg is maximum, so 
proceeding as before, row and column 8 are deleted. 
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Figure 3.13 The Second Reduced Matrix 
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Figure 3.14 The Solution Matrix 



It can be seen in Figure 3*l4> after deleting row 
and column 8 and carrying out step 3 that all remaining 
t. < e. and the optimal permutation is (1,2, 3,8,7 ,9) • This 
solution also has the property that for all solutions in 
which only three targets are not investigated, this permu- 
tation completes investigation of those investigated in 

minimum time. 

3. Proof of Optimality 

The algorithm is now proved to produce an optimal 
solution. The proof is similar to those used in references 
13 and 32 for the nearly equivalent jobshop problem in 
which processing and set-up times are sequence independent. 
Targets are separated into two disjoint sets, E and L, 
corresponding to those targets v.'hich are investigated early 
and those which are not according to the current subpermutation 
being considered. Define 
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Ej^ = those targets out of the first k which 
have been retained in the investigation 
schedule . 

Lj^ = those targets out of the first k which 

have been excluded from the investigation 
schedule . 

|Ej^| = the number of targets in set E^^. (Similarly 
for |Lj^|). 



Given that out of the first k targets in the se- 
quence |Lj^I must be excluded, then it is optimal to place 
those targets in Lj^ which allow the |Ej^ 1 targets in Ej^ to 
be completed in minimum time since this will allow the 
remaining n-k targets the greatest opportunity to be 
Investigated before their escape times. 

The optimality of this procedure can be seen by 

supposing that for some current sequence with jL^^l = j, 

2 < k < n, the next target in the sequence has 

In this case = J and minimal. On the other 

hand, if ^[k+1] l^k+1^ ~ J + The target to be 

placed in target r where r is in {k+1} and 

S = max is. : T. in E, M {k+1}}. Then 
r ^ 1 1 k 

^[k+1]" = Wl]" ^i’ ^ Hence the 

adjusted time to complete Investigation of target k, given 
that one more target has been placed in is minimized 

by selecting r for placement in L^. Optimality is thus 
proved. 



^5 



I 



I 



4. Discussion 



It Is instructive to note that this algorithm reduces 
to Moore's well known algorithm [Ref. 32], uf investigation 

times are sequence independent. If ° ' ’^nj 

for all 3, l.e.. if investigation times for all targets are 
independent of sequence, then the elements of the column 

of the problem matrix are all equal. The algorithm pre 
sented will in this case choose that target out of the first 
k with the largest investigation time and place it in L. 

This rule Is exactly the one used by Moore while obtaining 
optimal solutions to the equivalent job-shop problem with 

sequence independent set-up times. 

This Section treats only problems whose solution 

space consists of subpermutations of a single permutation. 
This characteristic allows efficient solution methods to 
be developed. When the sole optimal solution may be a 
subpermutation of several permutations, obtaining solutions 
becomes much more ' difficult . Such problems are the subject 
of the following Section. 
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IV. EVALUATION OF HEURISTIC SOLUTION METHODS 



A. INTRODUCTION 

This Section deals with the general combinatorial 
optimization problem presented in Section II in which there 
are no external limitations on sequence. The solution space 
for this problem is a discrete set of all subpermutations of 
the (n-1)! permutations of the Integers 2,3j**.jn. V/hen 
more than one permutation may contain the optimal subpermu- 
tation, it is necessary to explicitly or implicitly evaluate 
all such permutations in any search for the optimum. The 
degree of difficulty associated with a problem is directly 
related to the number of permutations which may contain the 
optimum. 

Experience in solving the general problem shows that the 
expected number of computations required tends to rise ex o- 
nentially with n, the number of targets. Optimal solutio s 
for even small problems, (10 targets), cannot be expectec to 
be obtained without the assistance of a computer. The actual 
environment in which the problem exists may make obtaining 
optimal solutions impossible in most cases and impractical 
in the rest because computers usually are not available. 

Even when they are, the time allotted for decision-making may 
make uncertainty in solution time unacceptable. In such 
cases the decision-maker has no alternative but to devise 
and use heuristic solution methods. 
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If it is necessary to use a heuristic, it is clearly 
desirable to use one which is known to be good in some sense. 
Determination of this fact requires the existence of a 
measure of effectiveness or efficiency for such rules. It 
is felt that the only true measure of an heuristic solution 
method is through comparison of solutions obtained with 
optimal solutions. Other relative measures are clearly 
possible, such as comparative testing. These measures 
illustrate dominance of one rule over another, but reveal 
little or nothing with respect to the optimum. The clear 
advantage in comparing heuristics to the optimum is that the 
decision maker can stop devising and testing new rules when 
one is found which produces solutions sufficiently close 
to the optimum. Comparative testing does not offer this 

choice. 

In this Section, a format for evaluating heuristics Is 
presented through consideration of one problem formulation. 
Three rules are devised and evaluated through comparison 
with optimal solutions obtained for two sets of randomly 
generated sample problems. Next, the branch and bound 
method used to obtain the optimal solutions Is described. 
Generalisations of the method are presented, describing the 
most complex target and Investigator motion which can be 
expected to be treated. A specific algorithm is then pre- 
sented, in flow diagram form, which can be used to solve a 
large class of Investigation problems. The solution for 
one sample problem Is shown, followed by a discussion of 
computational experience with the algorithm. 
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B. EVALUATION OF THREE HEURISTIC SOLUTION METHODS 



A problem description is given, followed by development 
and evaluation of three easy-to-use heuristic solution 
methods [Ref. ^2], 

Consider the problem v;here targets are located in a 
planar region and all are moving directly toward a prescribed 
border. The single Investigator moves v/lth a speed greater 
than that of any target and is free to change course instan- 
taneously. Naturally, he always moves at maximum speed. 

To investigate a target only requires that the position of 
the investigator and the target coincide. Investigation 
times correspond to travel times between pairs of targets 
which are sequence dependent functions of the time 
investigation is initiated. 

For this problem, the three heuristics listed below 
seem worthy of consideration. Each is an easily implemented 
rule which, upon repeated application, selects a feasible 
solution which intuition suggests may be good with respect 
to the optimum. 

1. STP - Shortest Time Path. This rule always directs 
the investigator to move next to that target v;hlch 
is closest in time to the investigator’s current 
position providing that the investigator can reach 
that target before it reaches the border. 

2. SDP - Shortest Distance Path. This rule directs the 
investigator to move next to the target closest in 
distance to the investigator’s current position 
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providing that the target can be reached before it 
crosses the border. 

3. CTB - Closest To Border. Using this rule the 

Investigator procedes next to the target closest 
to the border providing it can be reached before 
it crosses the border. 

The solutions generated by these rules are compared to 
the optimal solutions by considering forty problems each 
of which has twenty targets v;hose initial positions were 
generated randomly from a uniform distribution. The object 
nearest the border is considered to be the investigator. 

The other 19 are the targets. The data and solutions for 
all problems are contained in Ref. k2 - 

The region considered is 10 units wide and 10 units deep. 
In the first set of 20 problems the investigator has a spe d 
of 25 units per unit time, and all targets have a speed of 
15 units per unit time. In the second set of problem.s the 
targets have speeds drawn from a uniform distribution between 
10 and 20 units per unit time. 

A square region is used because this appears to present 
the most difficult problem for a fixed num.ber of objects. 

A wide, shallow region will allow the Investigator to capture 
only those few targets relatively near his position, most 
of the others being out of reach even if he goes toward 
them immediately. A narrow, deep region vjill present little 
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difficulty since the investigator will normally be able to 
capture a large fraction of the targets v/ith any reasonable 
sequence . 

1 . Same Target Speeds 

The results for this set of problems is summarized 
in Tables 4.1a and 4.1b, showing for each problem the number 
of targets investigated in the optimal solution and with 
each of the three rules. For each problem the ratio, called 
the effectiveness ratio, of the number of targets investi- 
gated using the rule to the number Investigated optimally 
is computed and the average of these ratios is shown in 
Table 4.1b. 



Problem 


OPT 


RULE 

STP 


SDP 


OIB 


Problem 
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Table 4.1a. Summary of Results for Problem Set One 
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RULE 


AVERAGE OP 

EFFECTIVENESS 

RATIOS 


STP 


.85 


SDP 


.92 


CTB 


CO 

• 



Table 4.1b. Effectiveness Ratios for Problem Set One 

It can be seen from Table 4.1b that for these tvjenty 
problems the best of the three rules is SDP. The STP and 
CTB rules appear to be less effective. The deficiency of 
the STP rule is that it has a tendency to move the inves- 
tigator outward from the border toward incoming targets, 
foregoing nearby targets v/hich might later be impossible 
to capture since they would have to be "run down" from 
behind. The CTB rule suffers from the deficiency that it 
causes the investigator to make more movements parallel to 
the boundary than might otherwise be required. Time is 
thus wasted' in back and forth motion. 

Each of the rules is nearsighted and looks only 
one step ahead, but in view of the results presented here 
it would appear that if computer equipment is not available 
to compute optimal solutions, the SDP rule should be applied. 
It is easier to apply than the STP rule since no relative 
motion calculations need to be made. 

When viewed in job-shop context, the CTB rule 
represents the rule "process next the Job nearest its 
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due-date," and the STP rule the "nearest neighbor" rule, 

(or process next that job with the shortest processing time). 
The results contained in Table . lb indicate that there is 
no substantial difference betv/een these tvjo rules. The 
SDP rule has no counterpart in the job-shop problem. 

Figure . 1 provides a pictorial representation of 
one of the problems just for illustration. It must be 
remembered that the targets are moving and the actual ground 
track of the investigator is not that shown in the figure. 
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2 . Different Tarp:et Speeds 

The results for this set of problems are summarized 

in Tables 4.2a and 4.2b. 



Problem 
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Table 4.2a Summary of Results for Problem Set Tv/o 



RULE 


AVERAGE OF 

EPFECTIVEI'ESS 

RATIOS 


STP 


CO 

o 


SDP 


.90 


CTB 


.87 



Table 4.2b Effectiveness Ratios for Problem Set Two 
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The results from these 20 problems with different 
target speeds tend to substantiate the results given for 
the previous set in that the SDP rule is more effective than 
either the STP or CTB rules in approximating the optimum. 

Using the data of Ref. 42, other heuristic solution 
methods can be suggested and evaluated. A multitude of 
heuristics have been developed in the closely related job- 
shop scheduling area, for example, see Refs. 6 , 19 > and 

20 . 

C. SYNOPSIS OF ALGORITHMS USED FOR OBTAINI NG OPTIMAL SOLUTIONS 
1 . Preliminary Remarks 

Optimal solutions being required in the evaluation 
of heuristic methods, it was necessary to develop a means 
of obtaining these solutions. The methodology of branch and 
bound [Ref. 26], was used for this purpose. Possible advan- 
tages of the branch and bound method for such problems is 
discussed in Ref. l6, and examples of applications to similar 
job-shop scheduling problems are contained in Refs. 5 , 

22, 28, and 31. 

Investigation problems may differ from each other in 
many ways, but from a computational point of view, the most 
pertinent difference Is in the description of target and 
investigator motion. As part of the Intent of this research 
Is to present analysis of a wide variety of investigation 
problems. It was necessary to develop algorithms for obtaining 
optimal solutions for several broad problem types. Each of 



55 



the algorithms possesses the same fundamental structure 
an implicit enumeration of all feasible solutions as directed 
by the branch and bound technique, differences arising 

mainly from the type of motion involved. 

The presentation in the next Section is a descrip 
tion of the branch and bound method as applied to investi 
gation problems. This is followed by the statement of an 
algorithmic framework which can be used to develop specific 
algorithms through selection of branching and bounding rules. 
The ability to specify usable branching and bounding rules 
is shown to be dependent upon the type of motion involved. 
Finally, the most complex motion for which optimal solutions 
can be expected to be obtained is discussed. 

2, Application of Branch and Bo u nd to Investigatio n 
Problems 

The branch and bound method consists of selectively 
partitioning the set of all feasible solutions and computi 5 
bounds on the objective function for each element cf the 
partition. This process is continued until one element of 
the partition containing a single solution is obtained for 
which the associated bound is at least as good as that of 
any other element, 

A feasible solution to an Investigation problem is 
a permutation describing a path for the investigator to 
follow in which all targets contained in the path are inves- 
tigated prior to escape, and investigation does not comme 
prior to target availability. For such problems, a branching 
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tree Is Initiated and extended such that each node at the 
end of a branch of the tree corresponds to a feasible solu- 
tion. The set of all such nodes specifies a partition of 
the feasible solution space. The bounds associated with 
each element of the partition, and therefore with each node 
at the end of a branch of the tree, represent a lower bound 
on the number of targets which will escape if any solution 
contained in that element of the partition is followed. 

Associated with every node of the tree is a target. 

The initial node, representing all solutions, corresponds 
to target number one, the investigator. Branching corresponds 
to selecting a node to branch from and specifying a target 
for use in extending the path specified by :that branch. The 
branch corresponding to node one naturally is selected 
initially for extension. This branch is extended to the 
right and the left by adding two new nodes to the tree, 
see Figure >t.2. The node labeled k represents all solutions 




Figure 4.2. Initial Branching 
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in which the investigator starts from his initial position 
and investigates target k next. The node labeled -k repre- 
sents all solutions in which the investigator does no^ 

investigate target k next. 

Associated with each node at the end of a branch of 

the tree is a path, starting with one, and including each 
target number corresponding to a positively labeled' node 
in the order in which they appear in the branch. For exam- 
ple, the node labeled k in Figure 4.2 corresponds to path 

(l,k), and the node labeled -k to path (1). 

When a branch of the tree is selected for extension, 
the path specified by that branch is called the current path 
The bound on each ending node with a positive label 
applies to all feasible solutions starting with the path 
specified by that node. The bound on those with negative 
labels corresponds to all solutions starting with the path 
specified which do not include as their next element, all 
negative labels of nodes at the end of that branch. In 
illustration of this, consider Figure 4.3. The bound on 
node labeled 7 applies to all solutions starting with 
elements 1, 2, and 7 , in that order. The bound on node 
labeled -2 applies to all solutions starting vjith element 
1 and not having either 4 or 2 as the second elem.ent. 

After a branch is selected for extension, it is 
necessary to determine which targets are eligible for use 
in extending the current path. This is done by determining 
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Figur6 ^ . 3 Sanipl6 TroB 

all targets not In the current path and not prohibited du 
to negatively labeled nodes at the end of the branch, wh oh 
could be investigated prior to escape if investigated ne. . 

The order of an element of the partition reduces to 
one when there are no targets eligible for use in extending 
the branch corresponding to that element. In this case, 
all targets are either in the current path specified by 
that branch, or are known to escape as a result of following 
that path. When an element is located with an exact bound 
less than or equal to the bound on all others, the path 
corresponding to the sole solution contained in that 

element is optimal. 
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^ The 'Pr’amewor k for Algor ithms — for Solvln g^ 

Investigation Problem^ 

Specific methods of branching and bounding are 
Ignored temporarily while the general structure of 
algorithms developed to date Is presented. This Is followed 
by a discussion of difficulties associated with the selection 

of these rules. 

Algorithm: 

1. create Initial node corresponding to target number one, 
the investigator. Compute a bound for this node. Go 

to 2 . 

, X Thn =! branch determines the 

2. Select a branch to extend. This orancn 

current path. Go to 3- 

3. Determine the set E of targets eligible for use in 
extending the current path. Put into set E indices 
all targets not In the current path which could be 
Investigated prior to escape If Investigated next. 

Remove from E all Indices corresponding to negatively 
labeled nodes at the end of the branch being extended. 

If 1^1 £ 1} stop. If not, go to 
1, select from E a target k for use In extending the current 

path. Extend the branch to the left and right creating 

two new nodes labeled k and -k. Go to 5- 
5. compute bounds for branches ending with nodes labeled 

k and -k. Go to 2 . 
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upon termination, if |e| = 0, the current path is 
optimal. If lEl - 1. the current path extended by the 
target corresponding to the element remaining in E is 

optimal • 

4 ! m fficulties ossoclated wi y Selection o X 
BFanohing and Rounding nul.ej. 

Branching Is a two part operation, consisting of 
first selecting a branch to extend, and next selecting 
target for use In extending that branch. It Is a common 
practice In branch and bound to use as the first of these 
steps the selection of that branch whose associated bound 

cp-irvinff tie breaking rules in the event 
is smallest and specifying tie 

they occur. This rule has been used exclusively. 

The second part of the branching operation Is 
particularly worthy of note. In this step, a target Is 
selected for extending the current path. It is clearly 
desirable to select a target which will extend the current 
path in a manner which Is optimal, or as near optama as 
possible, with respect to the objective. Such a rule 

the efficiency of the algorithm by decreasing 
increases the ei i icxeu'^.j^ 

a given path through addition of a single target In a ma 

whLh is optimal or near optimal, then repeated application 

^ ^ o fppc’-?ble solution which 

of only this rule should produce a feasible 

Itself is optimal or near optimal. Good rules for use in 

step Of the algorithm thus correspond to good heuristics 

/I TV R This fact makes it 
g, -VO cioP-^-ions IV, A and IV,B. J-nit, 

as discussed m Sections xv. 
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^ - r.r the alKorithxn can be used to 

apparent that the outpu. of the algo 

its effioienc For example, an arhitrar. ruie can 

,e usea initlaixy in this step, optical solutions aevelope . 

T The best of these heuristics can 

and heuristics evaluated. The 

then he used as the rule at this step, increasing the e 

ciency of the algorithm. Additional heuristics can 

T This learning feature was used 

more efficiently evaluated. This lea 

. Iffloiency of the algorithm 

to significantly Improve the efficien y 

presented in Section IV, E. 

The bound associated with each branch specifies a 

lower bound on the number of targets which will escape if 

the path specified by that branch is followed. For the^case 

when the last node in the branch has a positive labe , a 

loose but easily obtained bound corresponds to determinin 

.3 Of the time investigation of the current path is compete, 

how many targets have escaped uninvestigated. This bound 

IS tightened, with increased computation, by including i ^ 

the bound all targets which will escape uninvestig^te e^^ ■ 

if investigated next. This rule is used in the algori 

presented in Section IV.E. 

-h.. label of the last node m the 
For the case v;hen <whe la 

e • . the lower bound corresponds to the number 

branch is negative, the lower ^ 

1C the current path is followed and 
rhC tarerets to escape if the curitin 

all targets corresponding to nodes at the end of the branch 

:;_.;stive labels are ^ investigated next This bo nd 

13 particularly difficult to compute in that it must ahe 

t all feasible solutions for which the beginni g 
into account all leas 
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portion of the permutation corresponds to the current path, 
excluding those having as their next element an Index 
corresponding to one of the negative labels just described. 

A method of computing the bound which is not problem oriented 
IS to compute the bound as described in the preceding para- 
graph associated with the current path as extended by each 
eligible target and select the minimum of these as a bound 
on the negatively labeled node. An obvious acceleration 
is provided by computing these bounds sequentially, keeping 
track of the minimum bound computed to date, and terminating 
computation of the bound for a target when it Is found to 
equal the current minimum. This procedure was used In 
exp6rimGnt a.1 testing- 

D. PROBLEMS WHICH CAN BE SOLVED USING THE ALGORITHM 
1. Discussion 

The algorithm stated in the preceding section is 
really the skeleton of an algorithm. This basic structure 
must be augmented with branching rules and metho 
computing bounds consistent with the problem formulation. 
The selection of branching rules Is not difficult and can 
even be done experimentally. However, the determination of 
usable methods for computing bounds Is usually difficult. 

The technique Is essentially a "one step, look 
ahead" scheme in which a target is used to extend some 
branch, and the results of this extension are analysed and 
used as a bound on the path represented by the branch. 
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Xoo. ahea. portion, wMcn conresponao to co^putin, tne Pouna. 
is carried out by computing the time at which Investxgation 
of all targets In the newly extended path Is complete and 
determining the number of targets lost as a result of this 

extension. 

The determination of whether an algorithm can be 
aeveloped for a particular problem formulation depends on 
Whether meaningful bounds can be computed. The efficiency 
of any such algorithm depends heavily upon the 

which these bounds are computed. 

, p„i„™,o»tion of Sultabilit5L4fa_F02^^ 

I.(t ). the time required to investigate target j 

given that investigation of target. 1 is complete at time t, 

may be called for many times during the computation of one 

bound. There may be no hnown technique for carrying out 

,his computation due either to the complexity or uncertainty 

of the motion Involved - or, on the other hand, it may be 

.he case that the motion renders the functional form trivial. 

sc this is the point where the suitability of the 
In any case, tnis is on«= y 

^ 1 -houEh there may he no 

formulation is determined. Even though 

, • T ^ V ^ vjVlich is compnta 
standard technique for computing Ij ( ^ 

tlonally acceptable, it may be possible to develop new 
techniques through understanding and exploitation of the 

particular type of motion involved. 

Development of an acceptable functional form for 

Ij(tp is strictly problem oriented and will thus be 



illustrated by example. In the first example, the motion 
described is such that Ij(t^) takes on a very simple form, 
in the second, a careful analysis Is necessary to determine 
Whether the formulation Is suitable, after which special 
characteristics of the motion involved are noticed and ex- 
ploited in the development of a surprisingly simple func 
tlonal form. In both examples It is assumed that an Inves- 
tigation is complete when the position of the target Is 
reached, all targets are available at problem time zero, 
the investigator changes course instantaneously, and that 
the investigator's speed is upper bounded by s^. 

a. Same course and speed. Consider the case where 
all targets have the same course and speed and are preceding 
toward the border. Obviously it Is best for the investiga- 
tor to always proceed at maximum speed in this case. Inves- 
tigation times are thus sequence dependent travel times. ^ 
independent of start time, illustrating that Ij(ti^ 

the constant I^^ for 1 - 1. • • . ,n, J • 2 n, which can ' e 

■precomputed prior to application of the algorithm. 

b. Varying courses and speeds. Consider the case 
Where for each 1, each coordinate of target I's position is 
represented parametrically as a function of time, 
simplicity, assume the region to be planar and let the 
position of target i be represented by the couple 
(x^(t),yj^(t)). Let s^ be greater than or equal to the 

maximum speed of all targets. 
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It IS not clear that a functional form for Ij(t,) 
can be specified unless an optimal policy lor investigate 
speed can be determined. The following theorem specifies 

the required policy. 

11 T Let the speed of the investigator, s^(t). 

Theorem M.l: Ler 

-\ f r\ c. ) i e. 0 < s,(t) ^ s,. 

be restricted to the interval (0,s^), 1 . _ i 

Let targets have speeds s^(t), i - 

/jn • 0^5 ^3 t/h.Gn. 

If s, > s.(t), 1 = 2,3,. _ 

there exists an optimal solution in which the investigator 
always uses speed s^. 

proof: Let be an optimal solution containing n targets 

in Which, on some porbion of the path described by . . ^ ^ 

^ < s was used, 

between targets and speed s^C ) p 

will constructively be shown that v* remains optima i 

speed s- is used throughout. 

^ ^ < e * for all 

Since tt* is optimal, t^_ ^ j 

T i J are unaffected by a 

Note that t,* for 0 = I... -.i ,, Ion 

speed increase be^twoen targets and bu 

he Let t be the completion times after 
1 = i+l,...,n may be. Let 

^ ,._.+! n. Consider Figure . 4 . 

the speed increase for 0 - i . • • • ■ ^ 

-f- 'Lt rarv locations of S 

Positions A and B represent arbitrary 

i-y, (-C n) represents the motion 
^ ^ at time t * and path (,B,u; repi 

”i w t * to t « . 

of target "1^.1 during the per o , ”1+1 .^leator 

nepresents the assumed path followed by the 
using speed s^Ct) < s^. If s^ were used, s 

path such as CA.O is possible allowing intercept 
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'i+1 



Figure ^ ^ 



t < t * . Since is greater than or equal to the 

speed of target the investigator could proceed along 

path (C,D), arriving at D at some time t prior to 
and is free to proceed ^ unxts earlier from 

position D to lnvestigate''tLget 

t < t * for j = i+l,...,n after the speed increase, and 
since t/ < for J = i+l,...,n tt* remains feasible and 

thus optimal. 

If there were more than one portion of the path 
on which less than maximum speed were used, the same 
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reasoning shows that only improvement is the result of 

increasing speed to on all such portions. 

As a consequence of the theorem, it follows 

that there exists an optimal solution in which the invest' 
gator travels throughout at speed s^, turning only when an 
investigation is made. If < s^(t) for some i, then this 
is not necessarily true. In such cases s^(t), t > 0. becomes 
a decision variable, and a solution consists not only of 
the permutation , . . . . but also the speed function 

s^(t) for 0 i t = ^ 7 T • 

Under the conditions of the theorem, it is 

clearly always best for the investigator to proceed from 
point of departure to point of intercept in a straight line. 
Hence upon departing the location of target 1 at time t^. 

(x (t ),y.(tj^)), the investigator will proceed away from 
that point at maximum speed s^, and thus will be located 
somewhere on the circumference of a circle centered at 
(x.(tp,y,(tp) with radius ts^ where t is the time elaps. i 
slLe^eparture. Thus the investigator's position can be 
rGpr 6 S 0 nt 8 d as (x^y) where 



(xj^(tj^)-x)^ + (yj^(tj)-y)^ - 



(4-1) 



for some t > 0. The desired time, Ij(tp, is the minimum 
time at which the positions of the Investigator and target 
J coincide. Target j's position as a function of elapsed 
time t is (Xj(t^tt),yj(t,tt)). Substitution of these 
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coordinates into (^-1) in place of (x,y) yields 

(x.(t.)-x.(t.+t))^ + (y.(t.)-y.(t +t))^ = (ts^)^. (^-2) 

lljl J-XJ-L 

Equation (4-2) describes the condition which must be met 
if the investigator’s position and that of target j are to 
be coincident. The minimum real root of (4-2) is the 
desired value I.(t.). 

If s^ were not greater than the speed of all 
targets it would be possible for (4-2) to have no real roots. 
This would indicate that it is not possible for the inves- 
tigator to carry out the specified investigation. 

Problems in which targets have varying courses 
and speeds have been solved and the solution for one with 
40 targets is presented in Section IV, E. 

3. Types of Motion Lim.iting th e Applicability 
^f the Alg;orlthm~ 

The suitability of a formulation for application 
of the algorithm is dependent upon the ability to compute 
I^(t.) efficiently, which in turn depends upon the nature 
of target and investigator motion. The complexity of func 
tional' (4-2) is not apparent since functions x^(t) and 
y^(t) have not been described. The most general motion 
which can be handled is specified by determining what subset 
of all functions can be used to represent x^(t) and y^(t) 
and still expect the algorithm to produce an optimal solu- 
tion in reasonable time. A large subset of functions which 
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can be considered separately is P. the set of all polyno- 
mials. If the positions of targets 2 n are expressed 

as polynomials p(t) e P of degree two or less, then (4-2) 
is at most a quartic, for which efficient closed form root 
extraction techniques exist [Ref. 34]- those elements 

of P of degree greater than two, numerical methods could 
be applied, but the efficiency of these methods would 
render the algorithm impractical for large problems. 

It is interesting to note that if the speed of the 
investigator is given as a function of time, s(t), then 
(4-2) becomes 



t.+t 



(Xi(ti)-x^(t,tt»^ t (y,(t,)-yj(t,tt»^ = (t " s(s)dz)^ 



(4-3) 



This generalisation has application when considering Job- 
shop scheduling problems, in that variations in machine 
speeds can be handled. For such problems, (4-3) reduces to 



PiJ “ 



t j^+t 



s(z)dz 



(4-4) 



*^1 



where p^, is the processing time for Job j following Job 
if the mLhlne is run at normal speed. For ^example, if 
machine speed remains normal for some time t and then begins 
to diminish due to normal wear, s(t) would be as shown .n 
Figure 4.5. It may be that the machine is run at normal 
speed during the day shift, at some lesser speed during the 
night Shift, such a case is depicted in Figure 4.6. 
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Figure 4.6 Alternating Machine Speed 

E. ah algorithm for targets with different courses 
and speeds 

This section presents an application of Sections IV, C 
and IV, D to a particular problem. 
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1 . Problem Description 

An algorithm has been developed for the problem 

described In Section II, A and Is exhibited In the following 

section. The motion of target 1, 1 = 2,...,n Is represented 

by a velocity vector (v (l),v (1)). The position of each 

X y 

target at problem time t Is ( ( t ) ,y^ (t ) ) where 

x^(t) = xj + tv^(l) 

yi(t) = y? + 

where (x^,y^) Is the position of target 1 at problem time 
zero. Assuming the Investigator to have speed capability 
greater than or equal to that of any target, the appropriate 
functional form for I.(t.) Is given by equation (4-2). 

The branch selected for extension Is the one with 
minimum bound. If there Is a tie, the branch v;lth a positive 
label Is chosen. If both tied nodes have negative labels, 
the last node created Is used. The rule used for selection 
of a target to extend the chosen path Is the SDP rule dis- 
cussed In Section IV, B. Bounding procedures are described 
In Section IV, C. 

The border Is that portion of the x-axls described 
by the Interval [0,R]. 

The algorithm for this problem was coded In Fortran 
IV and run In experimental testing on an IBM 360. The 
follov;lng section contains the flow diagram of the algorithm. 
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followed by an example problem along v;ith its solution. 
A brief summary of computational experience is given. 

2 . Flovf Diagram 

The follov/ing notation is used: 



(x^(t ) ,y^(t ) ) = position of target 1 at time t. 

( v^(i ) , Vy ( i ) ) = velocity vector for target i. 

LN = sequence number of last node created in 

the branching tree. 

TN(i) = the label, or target number, associated 
with node 1. 



PRED(i) = the node immediately preceding node i in 
the branching tree. 



BB(1) 

B(i) 



= the bound on node 1. 



< 



BB(i) if node i is currently at the end 
of a branch in the tree. 

M otherwise. 



T(i) = the tim.e at which investigation of all 
targets in the path specified by node i 
is complete. 



INV = the target number specifying the location 

■of the investigator at the current 
iteration. 

MN = the node number of the last positively 

labeled node in the branch being 
extended. (Note that TN(MN) = INV.) 

BFN = the node at the end of the branch being 

extended . 

BTT = the target selected to extend the current 

path. 

IE(i) =1 if target 1 is eligible for use in 

extending the current path at iteratic • 
one . 

0 otherv/ise. (M large.) 
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E(l) =1 if target i is eligible for use in 
extending the current path. 

0 otherwise. 

TE(i) = E(i) except that TE(i) = 0 for all targets 

1 corresponding to negatively labeled 
nodes at the end of the branch being 
extended . 



The following is a brief description of the compu- 
tation carried out in each section of the flow diagram 
shown on the pages that follov;; 



a. (a) to (^ . Create node i and set IE(i) = 0 
for all targets i whose motion will not take 
them across the border. 

b. @ to ©. Compute the initial bound on node 
i and refine the IE vector. 

c. to (d) . Determine MN and the TE vector. 

d. to (e) . Select target BTT for use in 
extending the current path. BTT is the eligible 
target currently closest to the investigator. 

Next is the second closest. 

e. to (^ . Compute the bound on node labelec 
BTT. 

f. © to ©, Compute bound for NEXT. 

g. (g) to ©) . Sequentially begin to compute bounds 

for all other eligible targets, keeping track of 
the minimum which Initially is the bound for 
NEXT, and terminating computation v/hen the bound 
for a target is found to be equal to the minimum. 

h. © to © . Create new node labeled -BTT. 

i. @ to ©. Select the branch to extend next. 

j . © to © . Determine the set of eligible 

targets at the current iteration. 

k. ©) to END. Check for termination and prepare 
to print out solution. 
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[LN^LN+H 



[predTlnT^fn 1 







1 B(LNT^BB(MN)~~i 1 B(LN) =BB(BFN )J 



E(BTT) = ol 



T(LN)=T(BFN) + ^"1 




TATK=T(LN) + I u(T(LN) ) 
V =v? + TATK^v (k) 

y_ 




|b(ln)=b(~lnT+iJ 




.yes 
|bb(ln)=b(lh) ] 
eTbttTHT] 
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k=k+l 
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I 

I 



I 

1 



I 



yes 




© 




I MIN B=B(i) 



BFN=i 1 

< 



i=i+l 
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STOP=STOP + E(i) 



yes 



no 

yes 



no 



L AST=1 

< — 

i=i+l 



no 






T(LN) = T(BPN) + 
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3. Sample Problem and Solution 



This algorithm v;as used to develop optimal solutions 
for problem sets v;ith as many as 50 targets initially in 
the region. The solution obtained for one sample problem 
v;ith 40 targets is presented for illustration. The initial 
positions and velocities for the ^0 targets were selected 
randomly from uniform distributions, target speeds ranging 
from 10 to 20 units per unit time. The data is contained 
in Table i|.3. 

Only those 25 targets whose motion would take them 
across the border are shovm in Figure ^.7, their initial 
locations being denoted by circles. The optimal path for 
the investigator is shown with a solid line. The motion 
of all targets is shov;n with dashed lines. Heavy dots show 
the locations where investigations take place. The optimal 
solution is ( 1 , 2 , 6 , 4 , 8 , 21 , 13, 27 , l6 , 23 , 25 , 3^ , 20 , 15 , 35 j 28 , 37 ) • 

A set of seven such problems was solved on an IBM 
360. CPU time ranged from 2.^6 to 78.27 seconds, averaging 
3^1.91 seconds. The number of bounds computed ranged from 
102 to 2190 and averaged 1251. 
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TARGET 






V 

X 


V 

y 


TARGET 


X° 


y° 




1 

V 

y 


1 


6.51 


.49 


Max Speed = 25 


21 


6.56 


4.97 


.6 


-18.7 


2 


6.12 


.65 


12.5 


- 7.95 


22 


9.60 


5.00 ■ 


- 9.6 


- 2.7 


3 


.41 


.84 


10.9 


- 7.2 


23 


9.23 


5.05 ■ 


- .9 


-11.7 


4 


6.25 


1.84 


8.0 


- 8.3 


24 


.39 


5.46 


- 10.2 


- 2.1 


5 


8.16 


1.89 


3.1 


-16.8 


25 


5.51 


5.52 


5.78 


- 8.8 


6 


6.47 


1.92 


15.0 


-13.0 


26 


7.29 


5.55 


- 12.4 


- 5.2 


7 


.64 


1.94 


14.2 


- 8.5 


27 


5.48 


5.75 


.9 


-19.1 


8 


9.07 


2.68 


-18.7 


- 7.0 


28 


.55 


6.62 


8.6 


- 8.2 


9 


1.55 


2.96 


- 2.2 


-13.9 


29 


2.90 


6.63 


-13.9 


- 2.8 


10 


9.73 


3.04 


11.7 


- 6.8 


30 


.47 


6.70 


11.1 


- .7 


11 


O 

O 


3.74 


2.3 


-16.0 




6.53 


6.74 


18.6 


- .1 


12 


5.20 


3.79 


-15.3 


- 4.9 


■ 32 
1 


4.37 


7.09 


- 6.2 


-13.7 


13 


3.19 


3.85 


15.1 


- 11.8 


33 


4.39 


7.28 


14.6 


- 7.5 


14 


1.50 


4.03 


- 4.5 


- 12.6 


i 34 

1 


3.10 


7.32 


7.3 


- 12.8 


15 


9.62 


4.36 


-10.9 


- 6.2 


' 35 


.37 


8.39 


5.4 


-13.0 


16 


7.11 


4.36 


- 0.4 


-10.3 


36 


2.67 


9.08 


-13.0 


- 8.2 


17 


4.13 


4.43 


11.2 


- 3.3 


37 


9.63 


9.08 


- 6.7 


- 10.5 


18 


.80 


4.54 


3.6 


- 11.9 


38 


1.64 


9.15 


- 9.2 


- 5.0 


19 


8.56 


4.73 


.8 


-17.1 


39 


.98 


9.31 


14.7 


- 4.4 


20 


.88 


4.74 


9.8 


- 6.4 


40 


9.32 


9.40 


-12.7 


- 11.1 



Table ^.3. Example Problem Data 
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Figure 4.7. 



Sample Problem and Solution 
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4 . Remarks 



Earlier it was noted that the efficiency of an 



algorithm is directly related to the efficiency wioh which 
the value could be computed. This can now be 

illustrated. 

The algorithm presented In this section was used 
to obtain the optimal solutions used In the evaluation of 
heuristics In Section IV, B. The motion In the first twenty 
problems considered there specifies that all targets move 
toward the border at the same speed, and In the second, 
targets move toward the border at different speeds. For 
the first problem set, Ij(tp is Independent of time of 

initiation of investigation and thus it reduces to , 

. _ 1 = 2 ...,n, vmich were com.puted and stored 

prior to application of the algorithm. In the secona 
problem set I^Ctp is time dependent and had to be computed 
each time It was required by the algorithm using a modified 
form of equation (H-2). A comparison of computational 
results is shown in Table fl.4. Times are given in seconds. 



Motion Type 


AVG CPU 
Time 


STD. 

DEV. 


AVG # ' 

Bounds 1 

1 

1 


» 

STD 

DEV. 


Same Speed 


1.85 


1.14 


331.9 


225.1 


Different Speed 


13.5^ 


21.9 


540.2 


709.4 



Table H.ll. Comparison of Computational Results 
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Note that even though the average number of bounds 
increased only by a factor of 1.6, the average CPU time 
increased by a factor of 7-3. It is thus clear that the 
percentage of time spent in carrying out the Ij(t^) compu- 
tation is significant. For the second problem set this 
percentage is conservatively estimated using the data from 
Table 4.4 to be 60^. 
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V. UNCERTAIN INVESTIGATION TIMES 



A. INTRODUCTORY REMARKS 

In all problems considered thus far, investigation times 
Ij(ti) were required to be known vjith certainty. The actual 
random variation in these times is ignored for the obvious 
reason of simplification. However, even in the simplest 
formulations, these variations may be significant enough to 
warrant the added computational burden Involved in accounting 
for them. 

The nature of the variation is usually such that it can 
be approximated in distribution. It is a common practice 
in jobshop scheduling to approximate set-up and/or processing 
times using a normal or related distribution. Similar 
approaches appear appropriate for investigation times. B’or 
example, if targets are ships, travel times between known 
points v;ill actually vary due to changing wind and sea cor .1- 
tions. It is felt, that these times could be closely apprf ci- 
mated using a distribution in the normal family, parameters 
for which could be developed by fitting with an experimentally 
developed sample distribution. 

In order to determine the feaslbilly of a solution to an 
investigation problem, it is necessary to be able to compute 
or estimate the time investigation is complete for each 
target included. Hence, for solution tt , it is necessary to 
compute tj-jj for J=l,...,m v;here 
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Note that assuming investigation times to be knovm only 
in distribution makes Ij(t^) a random function for i=l,...jn, 
j=2,...,n. If the distribution of random variable is 

known and happens to have the reproductive property [Ref. 25] 
then the distribution of also known. The normal random 

variables may thus be computationally advantageous in that 
t is again a normal random variable with known distribution. 

[j ] 

Under this assumption, it is possible to efficiently 
solve certain types of investigation problems using the 
techniques of probabilistic programming. The class of 
problems which may lend themselves to these techniques 
includes problems having an integer linear programming for- 
mulation in which the number of constraints is not prohibi- 
tive. For example, if it is possible to reduce the solution 
s-et to subpermutations of a single permutation, as in 
Section III, then , solution techniques for at least moderate 

size problems may be possible. 

There is one group of investigation problems which is 
known to be solvable using these techniques and an efficient 
algorithm for obtaining optimal solutions has been developed. 
The problem is described and solved in the sections which 
follow. The problem is best understood using the notation 
and terminology of jobshop scheduling, in that a special 
case of the problem is well known [Ref. 32 ]. 
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B. SCHEDULING V/ITH DUE-DATES AND UNCERTAIN SET-UP 

AND PROCESSING TIMES 

The situation treated is one in vjhich a single machine, 
(investigator), is used to process a presently available 
set of jobs, (target s ) , with known due-dates (escape times). 
Each job consists of a single operation but set-up and 
processing times (investigation times) are random with 
known distributions. Once processing of a job has been 
initiated, it is processed to completion. The objective is 
to specify, prior to commencement of any job, a schedule 
which will minimize the number of late jobs. 

If set-up and processing times are knovm with certainty, 
Moore’s algorithm can be applied to produce the optimal 
schedule as follovis. All n jobs are ordered according to 
non-decreasing due-dates and partial schedules up to job i 
in the sequence are considered for 1 = l,2,...,n. If job i 
will be late if this ordering is follov;ed, then from among 
jobs one through i, that job with the largest processing 
time is excluded from the schedule. Repeated application of 
this exclusion rule each time a partial' schedule shows that 
a job must be excluded will produce a schedule in which the 
number of late jobs is minimized. 

In the problem being considered set-up and processing 
times are assumed to be random. The problem is cast into 
the form of an integer program and the constraints trans-' 
formed into chance constraints. A certainty equivalent for 
Moore's job with the longest processing time is achieved and 
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a generalization of Moore's Algorithm is presented. The 
algorithm is then proved to produce an optimal schedule for 
the deterministic equivalent problem. 

1 . Integer Programming Formulation 

It is assum.ed throughout that processing tim.es and 
set-up times are independent normally distributed random 
variables. The set-up and processing times for each job are 
summed to form a new random variable p, called simply 
processing time. 

The problem v.'lll initially be formulated as an 
integer program. Let p^j^ be the processing time for job i, 
i = l,...jn and d^^ the due date. Let = 1 if job i is 
included in the schedule and 0 otherwise. Jobs are indexed 
such that d^ ^ d 2 4 ... £ d^. Associated with each job is 
a constraint of the following form v:hich requires, if the 
job is processed, that it be completed prior to its due 
date : 



j = i 

Z p.x. 4 d. i = l, 2 ,...,n (5-1) 

j = l ^ ^ 

j=n 

The objective is to maximize Z x. , the number of early 

j = l ^ 

jobs . 

2 . Chance Constrained Formulation 

As the coefficients in (5-1) are random, these 
constraints cannot be met with certainty. Application of 
the technique of Ref. 9 transforms inequalities (5-1) into 
risk constraints where the degree of risk is determined by 
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the decision maker.- The problem then becomes 



maximize 



subject to P 



j==n 

I X 

j = l 
j=l 



j 



j=l 



P.x . 

J J 



< d. 
= 1 



> a , 



i- = 



1, . . . ,n 
(5-2) 



Constraints (5-2) now require that whatever schedule 
be selected, it must satisfy (5-1) v;ith probability at least 
equal to a. 

Note that the left hand side of each constraint in 
(5-1) is a sum of Independent normal random variables. 
Rewriting a constraint in (5-2) as 



P 



^1 



j=i 

Z p.x. > 0 

j=i J J " 



> a 



and normalizing, the equivalent form 



'^'((d, - I m.x.)/( Z v^x?)”^) ^ a 
j=l j = l -J 



(5-3) 



(5-4) 



is obtained where <*> is the cumulative distribution function 



for the standard normal random variable and p. has mean m. 

J J 

2 

and variance v.. Letting K be the inverse of constraint 
J 

(5-4) becomes 



d. - "^Z^ m.x, > K(a)( ^ vjxj)''^ . (5-5) 

1 j=l J J j=i J J 
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Auxiliary spacer variables 
tv;o constraints from (5-5) 



[Ref. 10 ] are introduced to obtain 
as follows : 



0=i , 

I m.x. + 

^ ^ * (5-6) 

j =i o p 

E v.x. + ywh > 0 
j = l ^ ^ 

Where h = (K(a))^ is replaced by Xj since being either 
0 or 1 it has the same effect, and y,^ is the spacer variable 



The final problem is 






maximize 


j=n 

E X. 

j = l 






subject to 


j = i 

E m.x + 

j=l 


v. <d 4 
1 = 1 


(5-7) 




j=i 2 

- ^ ^j'^j ^ 

j = l ^ 


y^/h ^ 0 i = 1 3 • • • 


(5-8) 




^j 


= O3I Yi i 0 





The resulting problem is a nonlinear integer program 
ming problem with n quadratic constraints. Due to the 
integer nature of the x^ the problem remains intractable, 
even in this simplified form. It is possible, however, to 
deduce a great deal about the nature of the solution through 

inspection of constraints (5-7) and (5-8). 

Note that in (5-7) instead of having a job’s comple- 
tion time constrained to be less than its due date. 
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in (5-1), the expected completion time plus a risk aversion 
factor, y^, is required to be less than the corresponding 
due date. Note also that (5-8) requires that the risk 
aversion factor be such that 

y. > (h E vfx.)^ . (5-9) 

1 0=1 J J 

As can be seen by consideration of (5-9), larger 
variances of jobs in the schedule up to and including jot i 
produce a greater risk aversion factor y^, and therefore 
more slack is required in constraint (5-7) over and above 
the expected processing time. 

3 . Development of the Deterministic Equivalent 

The above observations are .exploited and extended 
to produce a method of arriving at an optimal solution to 
the transformed problem. 

The problem development of sections V,B,1 and V,B.2 
effectively states that in order to arrive at an optimal 
schedule, one should order the jobs according to due-dates, 
compute the adjusted expected completion times of jobs in 
ascending order of job index number, and when the first job 
in the sequence is encountered for which constraint (5-7) 
is violated, select from among the jobs included in the 
sequence up to that point one for exclusion from the sequence. 

Letting represent the index set for jobs included 
in the schedule up to job i, when applying Moore's algorithm, 
a partial schedule is developed until job 1 is encountered 
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such that 



E 



j 




p. > 



(5-10) 



Moore then selects for exclusion that job whose exclusion 
minimises the left side of (5-10), i.e. Job k where 



p max Pj. , 



j in . 



(5-11) 



It is this minimizing characteristic upon which Moore’s 

proof of optimality is based. 

The certainty equivalent for Moore's Job with the 
longest processing time is Job k Identified In the following 
exclusion rule. 



EXCLUSION RULE: In the deterministic equivalent problem, 

when a partial schedule Ij_ is developed for which constra: .t 
(5-7) is violated, select for exclusion from I, index k wl )re 



m 



k 



+ h 



( I 




E 

J el. 




(5-12) 



= max 



rel 



i 




( I 
jeli 






( I 
jVri 




This is now shown to be true. It is useful to 
rewrite (5-7) and (5-8) as a single constraint by substituting 
the right hand side of (5-9) Into (5-7) yielding 
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1 = (5-13) 



j = l 



j=i 



Z m.x. + (h Z v?x.)"^ < 
j = l ^ ^ j=l ^ ^ ^ 



Suppose (5-13) is satisfied for job i-1, but not for 
job 1. Then the following condition exists: 



j=i-l 

Z m.x. + (h 



j=l 



J 0 



2 ,)s 

j=l 



< “^i-l 



(5-1^) 



and 



j=i 



j = i 



Z m.x. + (h Z v.x^)^ > d. 

.1=1 ^ ^ 4=1 0 j 



(5-15) 



where x.=l for j in I. and x.=0 otherwise. If r is in I. 

J ^ 1 0 1 

and x^ is set to zero, the left side of (5-15) is reduced by 



m^ + h^ 



( S 
jell 



2 
^j 



v:)"^" - ( 



z 

j/^r^ 






Setting x^=0 produces a left side in (5-15) less 
than or equal to d^_^ due to (5-1^) and d^^_^ < d^^, hence 
setting Xj^=0 where k is determined by (5-12) also produces 
a left side in (5-15) less than or equal to d^, leaving 
I -1 jobs scheduled for completion prior to their due 
dates, where |I| is the number of elements in the set I. 

In addition, among all possible schedules which complete 
|l^| -1 jobs prior to their due-dates with probability at 
least equal to a, rule (5-12) specifies that schedule vjhich 
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does so in minimum time. Repeated application of this rule 
each time an exclusion is required ensures an optimal 
schedule. Proof of optimality is presented in section V.B.6. 

4 . The Algorithm 

The steps of the algorithm are 

1. Order the jobs in due-date order. Set Iq = 4>- Set i=l. 
Compute h = ( 4> ^(a)) . Go to step 2. 

2. If i = n+1, stop. Otherwise form 
to step 3* 

3. If E m, + (h E vh** < d set i = 1+1 and go to 

Jail ■’ J^q 

step 2. If not, go to step 4. 

4. Select index k using the exclusion rule and remove k 
from 1 ^. Set i=i+l and go to step 2. 

Upon termination the indices remaining in set I^ 
represent an optimal schedule under constraints (5-7) and 
(5-8). 

Consider the following variation. Suppose among the 
original set of jobs there were one or more special jobs 
which the decision maker wanted included in the schedule no 
matter what the consequences to the resulting schedule. 

This variation is solved optimally under the additional 
constraints by applying the above algorithm except that the 
indices of the special jobs are never included in the set I, 
i.e., never considered for exclusion from the schedule. In 
this variation it may be necessary to exclude more uhan one 
job in order to ensure that a special job be included in 

the schedule. 
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5 . Example 



The algorithm is illustrated with the following 
example. The data for the problem are shown in Table 5.1. 




Table 5.1. Example problem data. 

For an arbitrary choice of a = .8^, h is computed 
to be approximately 1.0 at step 1. A new iteration is 
initiated each time step two is executed for the next job 
in the sequence. The six iterations required to solve the 
example are discussed below. 

1. Index 1=1, = {!}, m^ + = ^1 which is less 

than 6, the due-date of job 1, so job 1 satisfies (5-8) and 
i is set equal to 2. 

2. I 2 = {1,2} , m^ + m 2 + (v^ + V2)”^^13.16 which 

exceeds due-date 11 for job 2, so some job must be excluded. 
In step 4, for r=l, ^=2, ^ '^2 

8 . 16 , so k=2 and I 2 is now set equal to {!}. 

3 . ^, 5 . In iterations 3,^, and 5 no jobs require 
exclusion. 
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+ vg)^^31.83 



6. For 1=6, Ig = {1,3, ^,5, 6}, and 

2 2 2 2 
nil + m3 + ni|^ + + mg + ^^1 ^3 ^^5 

which exceeds due date 31 for Job 6, so one more job must 

be excluded. At step 4, k Is found to be 6 and 6 is 

removed from Ig. The remaining Indices in Ig represent an 

optimal schedule. 

If variances were assumed to be zero, this algorithm • 
corresponds exactly with Moore’s and the optimal schedule 
would be { 1 , 2 , 3,5,6}. However, due to the uncertainty of 
processing times and the requirement to complete the selected 
schedule v;ith probability at least equal to .84, two Jobs 
were required to be excluded Instead of one. 

6 . Proof of Optimality 

It will be assumed that application of the algorithm of 
section V,B , 4 to the problem with constraints (5-7) and (5-8) 
using (5-12) as the exclusion decision rule does not produce 
an optimal schedule and a contradiction is shown using an 
inductive procedure similar to that of Ref. 39 . 

Let, B be a set containing k Jobs excluded by the 
algorithm. Assume there exists another set C containing 
k-1 Jobs which allows n-k+1 Jobs to be completed prior to 
their due-dates, indicating that the solution obtained by 
the algorithm is not optimal. A contradiction to this 
assumption will be shovm. 

Let B^ be the set of indices for Jobs excluded from 

t h 

the sequence up to and including consideration of the 1 
Job in the sequence upon appliatlon of the algorithm. Let 
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be that subset of C containing job numbers which are less 
than or equal to i. Clearly = C. 

The proof will inductively show that 

^ |B^| for i=l,...,n. ( 5 - 16 ) 

The assumption requires for all i that 

j=i j = i 2 

I m.x. + (h Z v,x.)" < d. (5-17) 

j=l J J j=l ^ ^ ^ 



where x.=0 if j is in C. and x.=l otherwise. 

Let J be the first job encountered which fails the 
ai 

test in step 3 of the algorithm. The induction begins by 

showing that C must contain one or more job index numbers. 
^1 

(Clearly |B^| ^ | C^ | , for i=l , . . . , a^-1 . ) 

Given index a^, the following condition exists: 



J=ai 



j=l 



■^j 



Z m. , + (h Z "^vf ) ^ > d 



(5-lf 



j = l 



Going to step A, job J, is selected for exclusion 

°1 

from the schedule using the exclusion rule v;ith 

I = (1,2,.. .,a,} and b, is placed in , making |B | =1. 

Inequality (5-17) requires that there be at least one 

c, in {lj2,...ja-|} such that J is excluded from the schedule, 
X X ^ X 

hence 
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Note that If |C 1=1, the left side of (5-18) v/hen J, 

Is excluded is less than or equal to the same sum when 

J is excluded, 

^1 

Proceeding to the inductive step, suppose the 
algorithm has considered 1 < p £ n Jobs and that m have 
been excluded. It is thus assumed that 



= I Bp I <• I Cp I = q . 



Two cases need be considered. If m < q and/or no Job 

requires exclusion at iteration p+1, then the induction 

requirement (5-16) is trivially satisfied at iteration 

p+1. If m=q and an exclusion is required at iteration p+1 

it must be shown that m+1 = |Bp.j.2^| is less than or equal to 

I I . Note that application of rule (5-12) each time an 

exclusion is required and the fact that (5-17) must be 

satisfied guarantees that the left side of (5-13) with i=p 

and x.=0 for J in B and x.=l otherwise will be less than 
J , P J 

or equal to the same sum with x.=0 for J in C and x.=l 

J Jr J 

otherwise . 

Since exclusion is required at iteration p+1, 



J=p+1 

I 

J=1 



™J ^J 



J=P+1 
+ (h Z 



J=1 





(5-19) 



where x.=0 for J in B , and x.=l otherwise. But the left 

J J 

side of (5-19) with x.=0 for J in C and x.=l otherwise 

J P 

exceeds the left side of (5-19), and thus (5-17) will be 
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violated unless at least one more job index number is 
contained in Thus 



Vii - 'Vi' • 



In particular, let p=n-l and the desired contradiction to 
the assumption is achieved. 

C . REMARKS 

In this section, one problem formulation v;as solved 
optimally through application of the chance constrained 
programming technique of Charnes and Cooper [Ref. 9 ]. 

Other formulations may suggest application of different 
techniques in probabilistic programming. For example, for 
problems in which some or all of the escape times are 
uncertain and an integer programming formulation appears 
tractible except for the random elements in the constraints, 
it may be possible through application of "Linear Programming 
Under Uncertainty" techniques [Refs. 1^,15,29] to move all 
random elements into the objective function and minimize an 
expected value. 

The applicability of the branch and bound technique to 
problems with random Investigation times is unclear, however, 
the possibility is enhanced due to the work of Clark [Ref. 

11 ] in which a method of approximating moments for the 
maximum of a set of normal random variables is developed, a 
procedure which could be used in the development of branching 
rules . 
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VI. NON-ZERO RELEASE TllffiS 



A. INTRODUCTION 

Chapter III considers problems for v/hich a knov'jn ordering 
is externally imposed on all solutions and all targets are 
available at time zero. These problems are demonstrated 
to have efficient solution methods. Assuming that targets 
are all available at time zero corresponds to the standard 
assumption in job-shop scheduling that all jobs are available 
for processing at time zero. This assumption is very re- 
strictive and seriously conflicts with the actual circum- 
stances surrounding both job-shop and Investigation problems. 
In both areas there can be, and usually is, plentiful infor- 
mation concerning future arrivals. This chapter considers 
the implications of using this information during optimization 
instead of ignoring it. 

The analytical treatment of job-shop problems is very 
seriously complicated by the Introduction of non-zero re- 
lease times, (i.e., ready times or earliest start times), 
and as a result, very few attempts have been made at ad- 
dressing the problem [Ref. 12]. Each such attempt treats 
an objective related to flov; time. The zero release time 
assumption is made to allov; analytical treatment and is 
tolerated only because of the rate at which things happen 
in the job-shop. Schedules can be developed for those jobs 
currently in the shop and used until the number of new 
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arrivals Increases to some point where the current schedule 
Is no longer meaningful or acceptable, at which point a 
new schedule is developed, taking into account all old 
unprocessed jobs and all nev? arrivals. 

In Investigation problems, the rate at which events 
occur can be much faster than in the job-shop and the result 
of suboptimizing over the set of objects currently in the 
region of Interest can render the schedule obtained meaning- 
less. If the investigator has information concerning the 
location and motion of objects 'which are currently outside 
the region but will at some future time enter and pass 
through, then it is desirable to attempt to take these ob- 
jects into account when selecting a path to follow. For 
example, in the missile defense problem where the investi- 
gator is a missile system and objects are enemy missiles 
and aircraft proceeding toward the formation, virtually a! 
decisions regarding the order in which targets will be 
taken under fire should be made prior to the entry of any 
target into the missile envelope of the missile system. 

Thus, in this case, it is desirable to have the analytical 
treatment of the problem complete before any object enters 
the region. Any method which assumes zero release times 
for all objects is thus worthless in such cases. 

This chapter presents the results of analysis of the 
fundamental structure of the non-zero availability problem. 
The notation and terminology used throughout this chapter 
is that of job-shop scheduling as contained in Ref. 12 j 
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because the set of assumptions made to allov; the analysis 
casts the investigation problem into the exact form of a 
particularly easy to understand, (yet very difficult to 
solve), job-shop scheduling problem. 

The theory developed is exploited in the construction 
of simple algorithms for obtaining optimal solutions in 
certain cases. For those cases where a combinatorial 
approach cannot be avoided, it is shown that the theory can 
be used to drastically reduce the feasible solution space 
for a problem and also provide rapid accelerations for any 
combinatorial algorithmic approach. 

1 . Problem Statement 

The notation, most of which is that of Reference 

12, is as follov/s. 

J. = job number i 

1 ^ 

[i] = a subscript to denote the i element of 

a sequence 

= the i'^ job in a schedule 
Pj^ = processing time of 

r^ = release time of 

d^ = due-date of 

= waiting time until the start of in some 
schedule 

= completion time of in somie schedule 

~ ^i ” *^1 ~ lateness of in some schedule 
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} ^2 j • • • j ij-j ) 

DD order 
DD schedule 
R order 



R schedule 
1 ■<- j , spoken 



= max(0.L.) = tardiness of J. in 
some schedule 

= a permutation of numbers l,2,...,n 
= non-decreasing order of due-dates 
= one v/ith jobs arranged in DD order 
= non-decreasing order of release 
times 

= one with jobs arranged in R order 
"i before j", means that is 
scheduled before J, 



J 

Consider the job-shop problem viith one machine and 
n jobs in v^hich, for each i, job i is released to the shop 
for processing at time r^, takes p^ units of time to pro- 
cess, and is due at time d^. A job -once started is pro- 
cessed until completion. Let set-up be sequence independent 
and included in the processing time for each job. Jobs 
which cannot be processed prior to their due-dates are not 
processed, (or are processed at the end of the schedule in 
any order). The objective is to maximize the number of 
jobs processed prior to their due-dates. 

Letting m be the number of elements in permutation 
TT, the objective function, f(7:), for this problem is simply 
m and the problem statement is: determine a tt which will 
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i 



maximize m 



subject to 




i = 1 , . . . ,m 




The set of all possible solutions ti includes all 
permutations (i^^i^, • • • ,ij^) of integers {l,2,...,n} for 



at most once. 

2 . Separability 

It is possible for a problem to be separated, or 
partitioned, into smaller subproblems, each of vjhich can 
be solved independently. Two conditions under which this 
partitioning is possible are presented in theorems 6.1 anc 
6.2 



Theorem 6.1: Schedule all jobs in reverse due-date order, 

ignoring release times and observing due-dates, such that 
all jobs are completed as late as possible. Let there be 
k occurrences of machine idle time in this schedule. The 
n job problem can be partitioned into k+1 independent sub- 
problems of size n^ ,n 2 , . . . where ^2 ^k+1 ~ 

Let S^,...,S, be optimal solutions to subproblems 
l,2,...,k+l. The optimal solution to the n job problem is 



k = l,...,n in which each element i. in {l,2,...,n} appears 



Let jobs be indexed in DD order. 
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Proof: Let Figure 6.1 represent the schedule described 

showing the first occurrence of idle time. 





n-2 




J 1 

n-1 


J 

n 








1 


t 



d 



n- 



2 



d 



n-1 



d 



n 



Figure 6.1 

Note that whatever partial schedule is considered from 

among jobs {1 , 2 , . . . ,n-2) , it must be completed prior to 

d or it will not be feasible, i.e., it will contain 
n-2 

least one job whose completion time exceeds its due-date. 
Note also that whatever partial schedule is considered for 
jobs after it will never be necessary to have it start 

prior to d^_ 2 - Hence, if an iterative procedure is used to 
obtain an optimal schedule which considers jobs in DD order, 
the process can be terminated with J ^_2 and restarted, 
considering only jobs J^_^_ and starting at time 

max [d^_2, 

The same reasoning applies to all cases of idle 
time. The optimal schedule to the n job problem will 
clearly be the union of the optimal schedules to the sub 
problems with each job scheduled as early as possible. 
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Theorem 6.2: Schedule all jobs in R order, observing 

release times and disregarding due-dates, and scheduling 
each Job as early as possible. Let there be k occurrences 
of machine idle time in the schedule. The n Job problem 
can be partitioned into k+1 independent subproblems of size 

n^,n 2 ,...,n^^^ where n^ + n 2 + ... + = n. Let 

q S be optimal solutions to the subproblems 1,2,...,- 

k+1. The optimal solution to the n Job problem is 

q c S , sets being arranged in R order. 

*^2 * * * k +1 

Proof: Let Figure 6.2 represent a partial schedule developed 

as described above showing the first occurrence of idle 
time . 




Figure 6.2 

Note that whatever partial schedule is considered from among 
Jobs {3,...,n}, it can start no earlier than r^. Note also 
that no matter what the due-dates are for Jobs and J 2 J 
it will never be necessary to have a completion time for 
any feasible partial schedule constructed through 
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consideration of only Jobs and Jj which exceeds rj. 
Hence, an iterative procedure which builds an optimal 



schedule by considering Jobs in R order can terminate 
after consideration of Jj and restart at time ry ignoring 

all preceeding jobs. 

The same reasoning applies to all occurrences of 
idle time. The optimal schedule for the n Job problem will 



clearly be the union of the optimal schedules for the 
subproblems with all Jobs scheduled as early as possible 



Lemma 6.2.1: If the DD schedule is identical to the R 

schedule for a problem, then the R partition can be refined 

using the DD partition, or vice versa. 

The validity of the lemma is obvious since both 

partitions apply to the same sequence when DD = R. The 
following example is used to demonstrate the applicabllitj 
of the lemma. Let P be the DD partition and Q the R 
partition such that 



Q = {{ 1 , 2 }, {3,4, 5, 6 , 7)). 



Then the refined partition is 



{{ 1 , 2 ,},{ 3 , 4 >,^ 5 , 6 , 7 }>. 



113 



in all that follows, each problem discussed Is 
assumed to be reduced to minimum size and Jobs renumbered 

using integers 
B. DUE-DATE SEQUENCES 

Under certain circumstances it is possible to determine 
that there exists an optimal schedule in DD order, 
these instances the search for an optimal schedule is greatly 
Simplified in that only one of the n, possible trial permu- 
tations, that being a permutation containing all n elements 
(1,2,. ...n>, need be considered. Letting Jobs be Indexed 
in DD order, the problem reduces to determining the minimum 
number of elements which must be removed from the permutation 
(1,2,. ...n) in order to produce feasibility in the schedule 

represented by the remaining elements. A very simple algo- 

^*n Section VI, B, 2 which obtains optimal 
rithm is presented in becrion , 

schedules in such instances. Section VI,B,1 presents 

conditions under which there exists an optimal schedule in 

V, of oairwise comparisons 

DD order developed through a series ot pair 

of .^ob parameters. 

]_ , Partial DD O rderings 

+- ^ irTfb a set of jobs and their param- 
When presented with a sei oi j 

eters, p,, r,, and d,, it is possible to state, depending 

upon the results of pairwise comparisons of these parameters, 

that certain trial permutations need never be considered in 

any search for an optimal schedule. In some instances, 

but one trial permutation can be eliminated. 













I 



I 







6.^. and 6.5 derive the most general conditions known under 

Which this is true for the DD permutation. 

The first theorem eliminates trial permutations 

from consideration through comparison of adjacent pairs 

of jobs in any optimal schedule. 

Theorem 6.3: For every pair of Jobs J, and J,,, such that 

schedule containing 

r < r , if there exists an optimal scneaui 

bit.; /JL 1,,, in Which Itl V i. then there also exists 

an optimal schedule in which i v i+1. 

■r thp oroof is to assume that S is an 
Proof: The form of the prooi it> ^ 

optimal schedule with itl i and show that schedule S . 

which is identical to except that the two Jobs are 

switched such that ivltl, is feasible, and thus also 

optimal. Note that all Jobs in scheduled before 

and after J, will be uneffected by the switch, (see Figure 

6.3). Since is feasible, d. > and r^^j, < Cj . Let 




Figure 6.3 
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w be the start time of after the switch and be 

^ T after the switch. The facts 

the completion time of alter x.n 

di < d^^^ and r. < r.^^^ 

r^ < and = \ < ^i+i> 

so and will both be feasibly schedule in S^, 

showing that is also optimal. 

The second theorem eliminates trial permutations 

from consideration through comparison of arbitrary pairs 
of jobs. 

Theorem For pairs of jobs and Jj with 1 < J, 

. > r., and p. + Pj > - rj> there exist no optimal 

i 



schedules containing both and with j 



Proof: The proof will assume the existence of an optimal 

schedule with 3 - 1 and show a contradiction. Assume 



1. Pi + Pj- > ^i " ^j 



2. there exists an optimal schedule with j - i- 
In any feasible schedule with j ^ ^ ’^j and c^ < d^. 

Clearly > w . + p^ + P^- > hence 



^i ^ "^i 



w. + Pu + P^ = 
J a J 



r . < w . 



-J s "J hj + Pi P3 i =1 S '^1’ 

Pi + Pj = ^i " ^j’ 



which is the desired contradiction. 
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Under the conditions of the theorem, it is necessary 
only to consider trial permutations with job pairs 
in DD order. 

The partial orderings of jobs obtained through 
application of theorems 6.3 and 6.4 can be represented in 

the form of a directed graph. Let jobs > J2 > ‘ ‘ * ’“^n 

represented by nodes numbered l,2,...,n and each precedence 
relation " " developed through application of theorems 

6.1 and 6.2 be represented by an arc from node j to node i 
if 1 j . This graph is called the DD graph and is illus- 
trated with the following example. Consider the job set 
described in Table 1. 




Table 1. Example Problem Data. 



Application of theorem 6.3 results in the following 
precedence relations being established. 



1^2 2^3 3^5 4^5 

1^3 2^4 

1 4 2-^5 

1^5 
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Application of Theorem 6.^ establishes relation 3 

The DD graph for this example is illustrated in Figure 6.4 




Figure 6.4. Example DD Graph. 

« 

This graph is used to present a condition under 
which there exists an optimal schedule in DD order. 

Theorem 6.5: In the DD graph, if there exists a hamiltonian 

path from node n to node 1, then there exists an optimal 
schedule in DD order. 

Proof: Theorems 6.3 and 6.4 develop only relations between 

job pairs which, when represented graphically, are reverse 
arcs. The only possible hamiltonian path constructed only 
of reverse arcs is the reverse DD sequence. 

Under the conditions of Theorem 6.5 and due to the 
transitivity of the " <• " relation, the partial orderings 
of Theorems 6.3 and 6.4 Impose a complete ordering on the 
set l,2,...,n. Hence all trial permutations except 
(l,2,...,n) are eliminated from consideration. 
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For the DD graph depicted in Figure 6.4 in which 
only reverse arcs are allowed, the only possible hamiltonlan 
path from node five to node one is (5, 4, 3, 2,1) and it is 
trivial to determine if such a path exists. In the Sections 
which follow the DD graph will be augm.ented with a set of 
forward arcs, and again it will be desirable to determine 
if there exists one or more hamiltonlan paths. The practical 
applicability of Theorem 6.5 might thus appear to be doubtful 
as there do not presently exist any efficient methods of 
specifying hamiltonlan paths in arbitrary graphs, [Refs. 7 
and l8]. However, for the graph associated with this 
problem, a simple technique has been developed which 
identifies all such paths and is presented in Section VI, D, 2. 

2 . Due-Date Algorithm 

Under the conditions of Theorem 6.5, a problem can 
be solved very easily through application of the following 
algorithm. Let 

= an ordered set of job indlcles representing 
a partial schedule developed during 
consideration of Jobs l,2,...,i in the DD 
sequence . 

S( j ) = the reduction in completion time of a partial 
schedule as a result of excluding Jj . 

Algorithm : 

1. Index all jobs in DD order. Set 1^ = 4). 

Set i = 1. Go to step 2. 
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2. If i = n+1, stop. Otherwise form _lU i • 

Go to step 3. 

3. If T. < d. , set i = i+1 and go to step 2. 

jel. " "" 

If not, go to step 4. 

4. Compute S(j ) = min [p . , mln(w -r )] for all 

vel. ^ V V 

1 

v>j 

j £ I.. Select index k such that S(k) = max S(j ) ' 

^ jeli 

and remove k from I^. Set i = i+1 and go 

to step 2. 

The proof that the DD algorithm produces an optimal 
schedule rests on the facts that while iteratively building 
a schedule in DD order, if an infeasible partial schedule 
is produced, only one job must be excluded to obtain feasi- 
bility, and that the rule of step 4 selects that job for 
exclusion which allows the remaining partial schedule to 
be completed in minimum time. Prior to proving the opti- 
mality of the algorithm, these two facts are stated as 
Theorems and proved. 

Let C(I) be the completion time of schedule I. 

Theorem 6.6; Given that there exists an optimal schedule 
in DD order, if partial schedule ^ is feasible, but for 
^k), C(I^) > dj^, then one and only one job must 
be excluded from Ij^ to produce feasibility. 
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Proof: Since feasible and k can 

be removed from to produce a feasible schedule. 

The usefulness of the Theorem is in shov.'ing that at 
most one job must be excluded from to produce feasibility. 

Theorem 6.7: Given that there exists an optimal schedule 

in DD order and that partial schedule is feasible, but 

for ~ 1 {k}, > dj^, then excluding m from 

where 



S(m) = max S(i)’ 

allows the remaining schedule - {m} to be 

a) feasible 

b) have minimum, completion time as compared to 
all partial schedules I, - {j}, j e I . 

xC iC 

Proof: a) feasibility; 

All jobs in - {k} are feasibly scheduled in 
and will remain so if any j e j k is excluded, but 

for Jj^, Clearly C(Ij^) = ~ \ S and 

S(m) > Pj^. So, 

C(Ij^-{m}) = C(Ij^) - S(m) < C(Ij^) - p^^ = 
thus C(Ij^-{m}) < dj^ and - {m> is a feasible schedule. 
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b) minimum completion time: 



S(m) = max S(j) 



thus 



C(Ij^) - S(m) = C(Ij^) - S(j) for all j in 



and 



C(Ij^ - {m}) = C(Ij^ - {j}) for all j in 



so 



- {m} has minimum completion time. 

The proof that the DD algorithm produces an optimal 
schedule is now presented. 

Assume the DD algorithm is applied to a problem and 
a set of jobs E is excluded. Assume also that there exists 
another set of jobs P with |Pl < Ie] for which {l,2,...,n} 

- P is a feasible schedule, thereby indicating that solution 
{l,2,...,n} - E is non-optlmal. The proof will show by 
Induction that |e| < |P| , no matter what the set F is, 
thus contradicting the second assumption. 

Let Ej^ be the set of all jobs removed by the DD 

algorithm up to and including consideration of J , l.e., 

k 
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Ej^ = {eje e E and e < k} . 

Similarly, let 

Fj^ = {f]f e F and f < k} . 

The induction begins by shov;ing that |Ej^| ^ [F^^] 
where k is the first iteration at which a job is required 
to be excluded. 

To the job set of the problem, apply the algorithm 

until at Iteration k, feasible, {k} 

is formed and > d^^. By Theorem 6.6, one job from 

must be removed to produce feasibility. Index m is deleted 

from I, where for job J , 
k m* 

S(m) = max S’( j ) . 

J^^k 

Hence |Ej^| = 1. 

But since > d^^, there must be at least one f 

in F such that 1 < f < k, or else partial schedule 
{l,2,...,k} - Fj^ will not be feasible. Hence 

Note that if |Fj^l = ~ then by Theorem 6.7, 
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C({1,2, . . . ,k} - Fj^) > C({1,2, . . . ,k} - E^) . 

Now suppose at iteration t-1, ^ is feasible and 

at iteration t, formed and C(I^) > d^ . 

Let 

^ = 1^-1 1 = l^t-ll ^ 

C({1,2, . . . ,t-l} - E^_^) < C({1,2, . . . ,t-l) - 

Two cases need be considered. 

1. If q < q*, increasing the order of E by one v/ill 
not disturb the inequality jE^I < |F^I* 

2. If q = q*, note that 

C(I^) = C((l,2,.. .,t) - E^_^) 

= C({1,2,. . . ,t-l> - E^_^) + 

but 

d^ < C({lj...jt— 1} — ^t“l^ ^t 
< C({l,...-,t-l} - F^_^) + p^, 

so there must exist at least one f in F such that f is not 
in F^ ^ and 1 < f < t, or else the partial schedule 
{l,...,t} - F^ is infeasible. Thus 
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|F^| > |F^_^| + 1 = q + 1, 

which implies that 

q' + 1 > |F^| > |E^| = q + 1 . 

With this, the induction is complete and the 

contradiction to the assumption that |f| < |e| is evident. 

The DD algorithm provides optimal schedules for 

problems with due-dates and non-zero release times and is 

thus a direct extension of the work of Jackson and Moore, 

C^O], [ 32 ]. For the problem with r^ = 0 for i = l,...,n, 

Jackson’s lemma reduces the problem to consideration of 

only the DD trial permutation, and Moore’s algorithm 

efficiently extracts the optimal subpermutation. It is 

interesting to note that the algorithm of this section 

reduces identically to Moore’s if r^ =0, for i = l,...,n. 

This can be seen by noting that if r^ = 0 for all 1, then 

S( j ) = p. for all j and the exclusion rule of step ^ reduces 
J 

to selecting for exclusion from the Infeasible partial 

schedule at the current Iteration that job with the longest 

processing time, i.e., p = max p., which is the identical 

Jel. ^ 

rule used by Moore. 

C. RELEASE-TIME SEQUENCES 

The value of this section lies in the fact that there 
exists a theory relevant to R sequences which parallels 
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that for DD sequences. As in the case of DD sequences, it 
is sometimes possible to determine that there exists an 
optimal schedule in R order. The theorems giving the condi- 
tions under which this is have nearly identical statement 
and proof as those of Section VI, B except that jobs are 
indexed differently. When there exists an optimal sequence 
in R order, again it is necessary only to consider a single 
trial permutation from among the n! possible. Section VI,C,1 
presents conditions under vrhich there exists an optimal 
schedule in R order. In Section VI, C, 2 a simple algorithm 
is presented which extracts the optimal subpermutation 
from the R trial permutation. 

1. Partial R Orderings 

As shown in Section VI,B,1, pairv/ise comparisons 
of job parameters can be employed to eliminate from consid- 
eration certain trial permutations. Theorems 6.8, 6 . 9 , 
and 6.10 present conditions under which all but the R trial 
permutation can be- eliminated from consideration. 

Let jobs be indexed in R order. Theorem 6.8, as 
does 6 . 3 , eliminates trial permutations from consideration 
through comparison of adjacent jobs in any optimal schedule. 

Theorem 6.8: For every pair of jobs and with 

dj^ < if there exists an optimal schedule in which 

i+1 ■«- i, then there exists also an optimal schedule in 
which i i+1. 
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The proof in this case is identical in statement 
to the proof of Theorem 6.3> given the revised indexing 
procedure, and thus will be omitted. 

Under the conditions of Theorem 6.8, it is unnecessary 
to consider any trial permutation in which i+1 proceeds i. 

Lemma 6.8.1: If the DD trial permutation is identical to 

the R trial permutation, there exists an optimal schedule 
in R order. 



Proof: In this case. Theorem 6.8 imposes a complete 

ordering on the job set, 'i.e., there exists a hamiltonian 
path from node n to node 1 in the graphical representation, 
and by Theorem 6.5, there exists an optimal path in DD 
order, vihich is the same as the R order. 

It is interesting to note that Lemma 6.8.1 gives a 
condition under which there exists an optimal schedule in 
both R and DD order vahich is independent of job processin 
times . 

The following theorem is similar to Theorem 6.4 in 
that it eliminates trial permutations through comparison of 
job parameters for arbitrary pairs of jobs. 



Theorem 6.9: For all jobs J. and J. with i < j, d. > d., 

and p. + p. > d. - r,, there exists no optimal schedule 
1 J 1 J ^ 

containing both J. and J. v^^lth j -f- i. 

1 J 
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Once again the statement of the proof is identical 
to that for Theorem 6.4, given the new indexing procedure, 
and thus will be omitted. The usefulness of this theorem 
is that when considering trial permutations in search for 
one which contains an optimal subpermutation, it is only 
necessary to consider those in which i j . 

Theorems 6.4 and 6.9 are nearly identical in state- 
ment and proof and differ mainly in the method of indexing 
used. In order to illustrate the difference, a graphical 
comparison is made. In Figure 6.5 jobs are indexed in R 
order and d, - r. of Theorem 6.9 is shov;n. In Figure 6.6 
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Figure 6.6. Illustration of Theorem 6.4 
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jobs are indexed in DD order and d^ - r^ of Theorem 6.4 
is illustrated. These quantities are clearly different and 
only accidentally bear the same name due to the method of 
indexing used. 

As in the DD case, it is possible to represent the 
partial orderings developed through application of Theorems 
6.8 and 6.9 graphically. Let nodes be numbered in R order 
and let arcs be defined as in Section VI,B,1. This graphical 
reoresentat ion can be used to state a condition under V7hich 
there exists an optimal schedule in R order. 



Theorem 6.10: In the R graphical representation, if there 

exists a harailtonian path from node n to node 1, then there 

exists an optimal schedule in R order. 

The proof is identical to the proof of Theorem 6.5. 

2. Release-Time Algorithm . 

Under the conditions of Theorem 6.10, it is only 

necessary to consider the R trial permutation in the search 

for an optimal schedule. The following algorithm, which 

exploits this fact, is an inverted form of the due-date 

algorithm of Section VI, B, 2. Let I^ be an ordered set of 

job indices representing a partial schedule developed by 

considering jobs i, i+l,...,n in R order. Let W(I) be 

the start time of set I, and S(j) be the increase in start 

time of the partial schedule if J. is excluded. 

n+1 

1. Index all jobs in R order. Set I = 4>- 
Set 1 = n. Go to step 2. 
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2. If i = Oj stop. Otherwise form 
Go to step 3. 

3. Compute W(I^) = mln[V/(I^''’^) - p^, - p^]. 

If W(I^) > r^, set i = 1-1 and go to step 2. 
Otherwise, go to step 

Compute S(j) = mln[p., njln (d - C )] for all j 

^ J llv<j ^ 

in I . Select index m such that S(m) = max S(j) 

jel^ 

and remove m.from I^. Set W(I^) = W(I^) + p . 

^m 

Set 1 = 1-1 and go to step 2. 

The proof that the algorithm will produce an optimal 
schedule is simplified by first establishing two facts; 
first that while iteratively building partial schedules, 
if an infeasible partial schedule is developed, at most 
one job need be excluded to produce feasibility, and secor 
that the exclusion rule of step 4 excludes that job which 
allows the remaining partial schedule to have the latest 
possible completion time. These facts are stated as 
theorems and proved. 

Theorem 6.11: Given that there exists an optimal schedule 

k+1 

in R order, if partial schedule I is feasible and 

= I^'*’^ LJ {k} is not feasible because then one 

and only one job must be removed from I to produce 
feasibility . 
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Proof: Since I is infeasible, at least one job must be 

k+1 

removed to produce feasibility. Set I is feasible and 

so k can be removed from to produce a 
feasible schedule. 

Theorem 6.12: Given that there exists an optimal schedule 

k+1 

in R order and that partial schedule I is feasible but 

is not feasible because < r^, i.e., 

k k 

W(I ) < then excluding m from I where 

S(m) = max S( j ) 

. T-k 

allows the remaining schedule I - {m} to be 

a) feasible 

b) have latest start time as compared to all 
partial schedules - {j } for all j in I^. 

Proof: a) feasibility. 

k+ k 

All jobs in I are feasibly scheduled in I and 

will remain so if any job j in I , j / k, is excluded, but 

for J^, Clearly W(I^) = and \ 

/V. 

and S(m) > Pj^. 

W(I^ - {m}) = W(I^) + S(m) > W(I^) + = \ + P^’ 



but 
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\ ^ “ (m}), 

so schedule - {m} is feasible, 
b) latest start time. 

A\ 

S(m) = max S( j ) 

. -rk 

jel 

thus 



W(I^‘) + IC(m) > W(I^) + IC(j) for all j in 



and 



W(I^ - {m}) > W(I^ - {j}) for all j in 



SO 



I - {m} has the latest possible start time. 

The proof that the algorithm produces an optimal 
schedule is nov; presented. Assume the R algorithm is 
applied to a problem and a set of jobs E is excluded. 

Assume also that there exists another set of jobs P with 
|p1 < |e 1 for which {l,2,...,n} - P is a feasible schedule, 
thereby demonstrating {l,2,...,n} - E to be non-optimal. 

The proof will show by induction that |P| ^ jE] , thereby 
contradicting the second assumption. 
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Let E, be the set of all jobs excluded by the 
algorithm down to and including consideration of in 
reverse R order, i.e., 

E, = {e|e e E and e > k}. 

K. 

Similarly, let 



F, = {flf e F and f > k}. 
k ' 

The induction begins by showing that ^ 

where k is the first iteration where some job must be 
excluded from a partial schedule. 

Apply the R algorithm to the job set for the problem 

until for some k, is feasible, = I^''’^Lj{k} is 

formed and W(I^) < r^^. By Theorem 6.11, only one job must 
be excluded to produce feasibility. At step 4 is 
selected for exclusion where 



S(m) = max S( j ) , 




and thus |E | = 1. Note that since W(I^) > r^, there must 

xv 

be at least one f in F such that k < f < n, or else 
{k,...,n} - F will not be feasible. Hence 

xC 
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Note that, by Theorem 6.12, if |Fj^| = then 

W({k,...,n) - > W({k,...,n} - Ej^). 

Now suppose at iteration n - t , I is feasible 

and at Iteration n - t + 1, I*" = l’='"’'U(t) Is formed and 
W(I*^) < r^.. Let 

<3 = i l^t+ll “ 

W( {t+1 , . . . ,n} - ^t+1^ ” W( {t+1 , . . . ,n) - 



Two cases need be considered. 

1. If q < q*, then placing one more job index in 
E will not disturb the inequality |E^1 < |E^|- 

2. If q = q’ , note that 

W(I^) =-W({t ,. . . ,n> - E^^^) 

— W({t+l,...,n} — ^t’ 

but 

W({t+1, . . . ,n) - 

< W(fc+1, . . . ,n} - E^^^) - p^'< r^, 

so there must be at least one f in F such that t < f < n 
and f is not in F^^^ or else partial schedule {t,...,n> - F^ 
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will not be feasible. Thus 



|PJ > |Ft+ll + 1 = <3' 

which implies that 

q + 1 = lE^I < q’ + 1 < 1 • 

The induction is now complete and the contradiction 
to the assumption that |F| < 1 e| is apparent. 

D. GENERAL SEQUENCES 

Sections B and C present two conditions under which 
all trial permutations except one can be eliminated from 
consideration. In Section VI,D,1 it is shown that the 
preceeding theory can be integrated to obtain, in certain 
instances, trial permutations which are known to contain 
optimal subpermutations v;hich are in neither R nor DD order. 
Section VI,.D,2 discusses the case where it is not possible 
to reduce the set of candidate trial permutations to a 

single permutation. 

1. Special Cases . 

Given a job set, if neither the DD nor R graphical 
representation contains a hamiltonlan path from node n to 
node 1, it still may be possible to reduce the problem to 
consideration of a single trial permutation. Theorems 6.*] 
and 6.9 develop precedence relations between arbitrary pairs 
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of jobs which are Inhependent of method of Indexing used. 
Thus, the set of all relations developed by these two 
theorems can be coupled with either those developed by 
Theorem 6.3 or 6.8 to form a consistent and valid set of 

relations on the problem. 

Let the ADD graph be the DD graph augmented with 

all arcs developed through application of Theorem 6.9 and 

the AR graph be the R graph augmented with all arcs 

developed through application of Theorem 6.4. 

Theorem 6.13: If m either the ADD or the AR graph there 

exists a hamlltonlan path, then there exists an optimal 
schedule whose order Is specified by the reverse order of 
the hEiniltonian pEth. 

Proof: The arcs In the hamlltonlan path represent a set 

n-1 precedence relations which Impose a complete ordering 
on the job set and thus all trial permutations other than 
the hamlltonlan path. In reverse order, are eliminated 
from considGrEt ion . 



As the starting and ending nodes 



of such paths are 



not necessarily nodes 1 and n. visualizing such paths Is 
simplified by augmenting the graph with dummy source node 
s and sink node t and with arcs (l.s) for all nodes i with 
6‘‘'(i) = 0 and (t,J) for all nodes j such that 

= max 6-^Ck), k = l,...,n, where 6"(i) is the positive 
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I 



« 

I 

I 

I 




A hamiltonlan 



degree of node i and S'Cl) is the negative, 
path in the original graph is a hamiltonlan path from node t 

to node s in the new graph. 

If the set of candidate trial permutations Is 

reduced to a single one. the problem reduces to excluding 
the minimum number of Job indices from that permutation 
required to produce feasibility. This optimal subpermutation 
is obtained by indexing all jobs in order 1,2,. ...n where 
Hi 1 ) is the sole candidate trial permutation and 

applying either the DD or the R algorithm. 

2 . Combinatorial Accelera tions. 

Let Z be the set of all trial permutations which 
are not eliminated by one of the theorems of Sections II 
or III. If there does not exist a hamiltonlan path in 
either the ADD or the AR graph, then |Z| > 1 and each 
element of Z could contain the optimal schedule and there- 
fore must be explicitly or Implicitly investigated in any 
search for an optimal schedule. The combinatorial nature 
of such problems suggests that combinatorial programming 
techniques be applied. In combinatorial approaches such 
as implicit enumeration, branch and bound, and dynamic 
programming, the set of feasible solutions is implicitly 
enumerated in an orderly fashion by constructing partial 
schedules and attaching a value to each partial schedule 
consistent with the problem objective. Any such technique 
can be greatly accelerated by utilizing the information 
gained in the development of the ADD and AR graphs as 
demonstrated In the following sections. 
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a. Job Ranges. 

Given trial permutations tt = (tt^ ,tt2 > • ♦ • ^ 

let it(J) be the set of all positions held by 3, 1-e., 



Tt(3) = = 3. ^ 



z>. 



Let 



TT (j) = min i 
^ i£7T(j) 



and TT 0 ( J ^ " max ^ i 
^ ieirCO ) 



Let (>r^(3),'r^(3)) be called the range of m Z. Clearly 
any trial permutation In which 3 is not In some position i 
such that a^(3) < 1 .< considered In any 

search for an optimal sequence. These range boundaries are 
immediately available from the graphical representation. 

For each node 3 of the graph, let *^(3) = 6^(3)+l and 
IT (j) = n - 6"(o'). This is seen through consideration 

of the example graph in Figure 6.7. 




Figure 6.7 Example Graph. 




Note that there are no jobs which must preceed either 
or J 2 because there are no arcs which are positively inci- 
dent with node 1 or node 2. Thus tjl) = 6^1) + 1 " 
and similarly it^( 2 ) = 1 - Note also that J, must preceed 
J, and Jg in all elements of Z, hence 1 can hold no position 

greater than tj^(l) = n - 6 ‘(D = “I • Similarly. 

„ (2) = n - «'(2) = 2- Thus the range for is (l.'O 
and for Jj is (1.2)- The ranges for jobs J 3 , J,, J 5 and 

J.. can be computed to be (2,3). (^.5). (3,5), and (5, 

6 

respectively . 

Combinatorial approaches can be accelerated 
by exploiting the Job ranges developed to reduce the number 
of partial and complete schedules which need be evaluated. 
For the example graph. Table 6.2 is easily constructed 
from the job ranges computed and lists all jobs which could 
occupy each position in a trial permutation contained in 7 



1 

position i = 


123^56 


candidate 
jobs for 
position i 


11114 6 

22345 
1 3556 



Table 6.2 



Table 6.2 provides any algorithm which builds 
and extends partial schedules with a greatly reduced set 
of jobs which are eligible for use in extending whatever 
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current partial schedule is being considered. In the 
example, for instance, if a partial schedule of length tv;o 
is being considered, then at most two jobs can u^.,d 
extend the current schedule, and perhaps Just one. Without 
the table, as many as four need be investigateo . 
b. Complete Specification of Z. 

It is possible to use the information contained 

in the table of the preceding section to list each trial 
permutation contained in Z. When jzj is small, then total 
enumeration over Z using an efficient algorithm such as that 
of Section II m.ay compare favorably vnlth any comb-na^oricz. 

m.ethod available. 

All elements of Z can be illustrated graphically 
by constructing a branching tree with n+1 levels as follows. 
Consider Figure 6.8 which is the tree constructed from 
Table 6.2. At level zero, create node zero. From ncce 
zero branch to level 1 to new node J where J is liszec in 
column 1 of the table. From each node at level 1, branch 
to level 2 to new node k such that k is in colu.mn ^ ^n 
table and k is not in the current path. This process _s 
continued until level n is com.plete. The eiemen.s Ox i 
are those branches containing n+1 nodes. Note tnat ever^ 
branch in the tree is a subpermutation of some element 

Z. 

There exists an alternate m.ethcd of depicting 
each elem.ent of the set Z as a hamiltonian pa..n -*o... 



lUO 



i 

I 



level 0 




Figure 6.8 

dummy source node s to a dummy sink node t in a graph 
containing nodes l,2,...,n constructed as follov;s. Include 
all arcs (jji) with i < J included in the complement to the 
DD graph and all arcs (ijj) with i < j, except arcs 
(i,k)j i < k, such that there exists a path (k,jji) in the 



\ 



DD graph. Include an arc (s,l) for each node 1 such that 
6'^(i) = 0 and an arc (j,t) for each node j such that 
<5~(j) = 0. The resulting graph contains all elements of 
Z as hamiltonlan paths from s to t , and, in fact, the 
elements in Z are the only hamiltonlan paths in the graph. 
Figure 6.9 shows this graph for the DD graph given in 
Figure 6.7. This approach to the determination of all 




Figure 6.9 Graph Containing Elements of Z 

elements of Z does not at present appear to be practical 
due to the lack of efficient methods for specifying 
hamiltonlan paths in arbitrary graphs and also due to the 
ease v;ith v/hich these elements are determined through 
construction of the tree shown in Figure 6.8. 

The tree illustrated in Figure 6.8 displays 
each trial permutation which could contain an optimal 
solution, and therefore could be used to determ.ine all 
alternate optima. 
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If only one optimal solution is desired, the 
entire tree need not be constructed. Application of the 
methodology of branch and bound can greatly reduce the 
number of nodes which must be created in the tree by com- 
puting a bound for each newly created node. This bound 
represents a lower bound on the number of jobs which must 
be excluded if jobs must be processed in the order speci- 
fied by order in which node labels appear in the branch. 

For example, consider the partial branch (0,1,3) in Figure 
6.8, representing all permutations starting with elements 

1 and 3. Through consideration of Table 6.2 only, a bound 
of one can be associated with the node labelled 3 in this 
branch since is not Included and it is known that index 

2 cannot hold any position in a trial permutation greater 
than two. In general, bounds can be computed on each 
newly created node by indexing jobs according to the order 
in V7hich they appear in the associated branch and applying 
the DD algorithm. • Obviously it is best to pursue that 
branch currently having the minimum bound. 

3. Remarks 

This section provides a theoretical basis for the 
development of efficient solution methods for problems with 
non-zero availabilities and, where possible, presents 
efficient algorithms. This completes the presentation of 
research results pertaining to the problem stated in Section 
11(B). In the following chapter, generalizations of the 
problem are considered and their applicability noted. 



Avenues for future research on related problems which 
appear to be particularly promising are suggested. 
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VII. GENERALIZATIONS 



A. INTRODUCTION 

This section contains a discussion of several problems 
which are not central to the main theme of the research 
reported here but represent promising avenues for future 
research in Investigation Theory. In each case, the problem 
of Section II, B is directly extended and the results obtained 
for that problem which are applicable to the extension are 
summarized, along with additional facts which are immediately 
apparent upon consideration of special problem structure. 

In some cases these results suggest solution methods which 
are noted. 

B. THE VALUE PROBLEM 

The objective "minimize the number of targets to esca e 
uninvestigated" implies that all targets are of equal wor h 
or value. In many formulations this is appropriate, but .n 
others it is not. For example, in the Market-time problem 
discussed in Section I, a large ship appears to be of greater 
value to the investigator than a small one in that it can 
carry a greater amount of supplies. 

A direct generalization of problem (2-1) is obtained 
through changing the objective to maximization of the value 
of targets Investigated. For problems whose solutions are 
known to have a specified ordering, this generalization has 
been shovm to be solvable in Section III,B,6 using dynamic 



programming. For other problems the general algorithm of 
Section IV, C, 3 can be modified to handle this objective by 
letting the bound associated with each node in the tree be 
the sum of the values of targets lost rather than the number 
lost . 

It is felt that there is sufficient structure in this 
extension to allow development of solution methods even more’ 
efficient than dynamic programming. It is also felt that 
the search for such techniques should begin through consid- 
eration of the following job-shop formulation which is 
called the value problem. 

1 . Problem Statement 

Consider the job-shop scheduling problem with one 
machine and n jobs, each v;ith processing time p^, due-date 
d^, and value > 0. If job i is processed prior to its 
due-date, full value is realized. If not, zero value is 
realized. Determine the schedule with maximum value. 

2 . Summary of Results Applicable to the Value Problem 

Jackson’s lemma [Ref. ^0] applies to this problem 

and therefore only solutions in non-decreasing order of 
due-dates need be considered. This is verified by noting 
that given any optimal solution not in due-date order, the 
same jobs can be rearranged in due-date order producing a 
feasible schedule containing the same jobs. In the follovJing 
discussion, jobs are assumed to be indexed in due-date order. 

As a result of the lemma, the follov/ing Integer 
programming formulation of the problem is possible. Let 



1^6 



! 



I 

* 



= 1 if Job i is contained in the schedule, and = 0 
otherwise. The problem is to determine x^, i = l,...,n in 
order to 



i=n 

maximize E V. x. 

i=l ^ ^ 

J = i 

subject to E p.x. <_ d. (7-1) 

j=l 0 J 1 

X. = 0,1 J = 1 ,. . . ,n 

tJ 

This formulation suggests that Moore’s approach 
[Ref. 32] may be appropriate. In such an approach excluded 
Jobs are not considered for reentry into the schedule. 
Assigning different values to different Jobs makes such a 
method incorrect in that Jobs once excluded by such a pro- 
cedure need be considered for reentry when further 
infeasibilities are encountered. 

The lemma reduces the problem to one of excluding 
Jobs from the schedule (l,2,...,n) in, order to maximize the 
value of the remaining Jobs. The number of subpermutations 
of (l,2,...,n) v^hlch need be considered can be reduced by 
taking advantage of the following observations. 

a. Let T^ be the tardiness of Job 1 in som.e schedule. 

Let T = max T. in schedule (l,2,...,n). All Jobs J. , 
m j j 1 

m < i £ n are contained in all optimal solutions. This 
fact is seen by noting that once the tardiness in the 
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! 



schedule up to and Including job Is rectified, all 

subsequent jobs can be feasibly scheduled. 

b. Let l<i<j<n. IfV. <V. and p. > p., 

then there exists no optimal schedule including and 

excluding J.. This fact is verified by assuming tt° is an 
J 

optimal schedule containing J. and not J. and showing that 
schedule which corresponds to 7 r° except that it contains 

J. and not J. is feasible and has greater value. This fact 

j 1 

eliminates from consideration all subpermutations containing 

i and not j. Obviously, if there exists a job J such that 

m 



V > max V. and p < min p. , 
m — 1 m — 1 ’ 

then J is contained in all optimal schedules, 
m 

c. Similarly, if = 0 for 1 = l,...,k-l and 

T, > 0 and there exists a job J with 1 < m < k such that 
k m — — 



V 

m 



< min 
i=l, . . 
l^m 




and p 
^m 



> max 
i=l,. . 
l^m 




y 



then there exists no optimal schedule containing J . 

^ ° m 

d. If there exists ajobJ,l<m<n such that 

m — — 



V 

m 



i=n 
> I 
i=l 
ij^m 



V 



i 



then since d > p there exists an optimal schedule containing 
m m ^ 

J . This fact can be extended as follov;s. Let I be a set 
m 
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of Jobs known to be included in all optimal schedules. If 
there exists a Job such that l£u£n, u^I and 



V > 
u 



I 

U1 

It^U 



V 



1 



and IU{u} in due-date order represents a feasible schedule, 
then is contained in all optimal solutions. 

3. Possible Solution Methods 

Under certain circumstances, obtaining optimal 
solutions is trivial. For example, if the due-date order 
corresponds to a non-increasing processing time order and 
to a non-decreasing value order, then excluding jobs from 
the schedule (l,2,...,n) starting with J^, then etc., 

until feasibility is attained will produce an optimal sched- 
ule. This is because such exclusions take the Job scheduled 
with the largest processing time and smallest value and 
remove it from a position which reduces the completion time 
of all remaining Jobs. 

Another trivial case is seen by letting be the 
maximum tardiness in the schedule (l,...,n) up to and 
including . For J^, is known to be zero or else 
is initially removed from the problem, hence T~ = 0 also. 

Let 1^ be such that 



1^ = min {J|T^ > 0}, 



1^19 






I. 



and 



I2 = min > 0, j 5^ 1^}, 

etc. The sequence (i^ ji2 i • • • jlj^) represents the places in 
the schedule (l,...,n) where maximum tardiness increases. 
Then, if 

^1 i 

T = max T i = 1 , . . . ,n , 



then the optimal schedule contains job indices 

{i.. + 1 , i.. + 2 , . . . ,n} and als.o all jobs Indices j for v/hich y. 

J- 1 

equals one in the follov;ing knapsack problem. 



maximize 



subject to 



^ V.y. 






JO 



2 p.y. i d 
j=i J ^ ^1 



( 7-2 



Yj j d>***>d^ 



If the facts of Section VII, B , 2 significantly reduce 
the order of the set of feasible solutions, then an implicit 
enumeration over the reduced set appears to be an approach 
which would compare favorably with the dynamic programming 
scheme of Section III. Further reductions in the order of 
the feasible solution set may be possible. This is an 
area suggested for future research. 
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C. PROBLEMS WITH MORE THAN ONE INVESTIGATOR 



This dissertation deals mainly with investigation 
problems in vrhich there is a single investigator. Generali- 
zation to the case of multiple investigators was shovm to be 
possible in Section III when a known ordering is externally 
imposed on all optimal solutions. The solution method 
described is dynamic programming in v/hich the state variable 
X is a vector v;ith dimension md+1 where m is the number of 
investigators and d is the dimension of the region. Since 
this approach is computationally impractical for even small 
m and d, the search for practical methods seems to be a 
worthwhile avenue for future research. 

Although the treatment of the one-machine job-shop 
scheduling problem is quite broad, generalizations to more 
than one machine are rare. One of the only significant 
achievements is that of Johnson and Jackson [Refs. 2^ and 
23] for the two machine problem in which the objective is 
minimization of maximum flow time. 

Analysis of multi-investigator problems should clearly 
begin through consideration of problems with tv;o investiga- 
tors. It is felt that the following scheduling problem is 
an appropriate point of departure. 

Consider the n job, two machine problem in which jobs 
have processing times p^^ and due-dates d^ for i = l,...,n 
and the objective is to maximize the number of jobs processed 
prior to their due-dates. 
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1 . Integer Programming Formulation 



The problem has the following integer programming 



formulation. Let x.. = 1 if J. Is scheduled on machine A, 

Aj 0 ’ 

and X. . = 0 otherv;lse. Similarly for x„ . . The problem is 
AJ bj 

to determine x. . , j‘ = 1 ,..., n to 

AJ JjJ 



n 

maximize E Ex,. 

i=A,B j=l 

k 

subj'ect to Z P-^A-£d k=l,...,n (7-3) 

4 _ 1 J A J K 



k 

i '*k I' = 

J 

Xaj + _< 1 j = 1, . . . ,n 

X.. = 0.,1 1 = A,B j = l,...,n. 

^ J 



2 . Discussion 

Although the following is not Intended to represent 
a complete analysis of this problem, several facts appear 
worthy of mention. 

Let and Ug represent schedules for machines A and 
B. There exists an optimal schedule tt° = > that 

being one in which |tt^| +|’'Tgi is maximized, for which j'obs 
in both TT^ and iTg are arranged in non-decreasing order of 
due-dates. This is an obvious extension of Jackson’s lemma 
for the one machine problem. This fact indicates that an 
approach similar to that used by Moore [Ref. 32] for the one 
machine problem may be appropriate. 
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Such an approach v;ould iteratively schedule jobs on 
either machine until a job is encountered v/hich cannot be 
feasibly scheduled. Vlhen this occurs in the one machine 
problem, one job must be excluded. In the two machine 
problem this is not necessarily true. It may be possible 
to rearrange the schedules on A and B such that all jobs are 
completed prior to their due-dates and thus no job need be 
excluded. Each time this is not possible, excluding that 
job currently scheduled on either A or B with the longest 
processing time v;lll produce an optimal schedule. 

The difficulty in this approach is associated with 
the method of rearranging jobs to see if all can fit. Let 

be the first job which cannot be scheduled feasibly on 

Ic Ic k 

either machine and let tt = TTg) be the partial schedule 

developed up to and Including consideration of J^. Rearrang- 
ing the partial schedule ^B~^^ such that all 

jobs {!,..., k-l} are feasibly scheduled and the completior 
time on either machine, say machine A, was minimized lead: 
to an optimal schedule since if could ever be scheduled 
feasibly, it could be appended to the end of the resulting 
schedule on machine A. 

This optimal rearrangement can be obtained through 
solving the following problem. 
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minimize 



k-1 



subject to E P-X.. < d. i = l,...,k-l 



j=l 



j Aj - -i 



,^^Pj^Bjl^i i 



. ,k-l 



(7-A) 






y ® ^ 3 1 5 • • • 5 k^l 



The number of variables in (7^^) can be reduced to 

k-1 by letting x^. = 1 - x-. and rewriting the constraints 

hj AJ 

as 



E p. - d < E i ^ 

j=i ^ ^ j=i ^ 



,k-l 



( 1 - 5 ) 



Ojl j l,...5kl. 



The resulting algorithm for the two machine problem 
would be to schedule jobs arbitrarily until an infeasible 
partial schedule is developed at index k in the due-date 
sequence. Solve problem (7-^) and attempt to append at 
the end of the resulting schedule on machine A. If it fits, 
continue to schedule as before. If it will not fit, exclude 
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that job currently scheduled on either machine having longest 
processing time. Continue to schedule as before. Each time 
an infeasible partial schedule is developed, apply the same 
exclusion procedure. 

What remains to be done to make this algorithm of 
practical use is the development of an efficient solution 
method for problem (7-^)* 

The two machine problem (7-3) is easily generalized 
to m machines as follovjs. 



maximize 



m 

E 

1=1 




subject to 



k 

E 

j = l 



Pj^lj = 



m 

E 

1=1 




< 



1 



i = 1 

j = 1 



(7-6) 



,m k = 1 , . . . ,n 






X.. =0,1 1=1, ...,m k=l,...,n 

— J 

Contingent upon development of a solution method 
for problem (7-^) efficient enough for practical use, the 
algorithm stated for the two machine problem could be 
generalized to handle this problem. 



D. OTHER PROBLEMS 

Other interesting problems include one in v;hich the 
investigator can temporarily increase speed but must pay a 
price to do so, an exam.ple being use of after-burner on 
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interceptor aircraft. This problem can be translated into 
a job-shop problem v/ith one machine, n jobs, each v;ith 
processing time p^, due-date d^, and each having value V^. 

The operator has the option of running the machine at two 
speeds - normal, which costs zero dollars, or fast, vjhich 
costs C dollars per unit time. The problem is to determine 
that schedule v/ith maximum value. 

Another interesting formulation is a further generalization 

<• 

of the two machine problem discussed in Section VII, C v;here 
processing times differ from machine to machine, along with 
the value for processing. None of these formulations are 
considered here. 
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